hi, i have a chatbot that's supposed to answer domain-specific questions (by embedding about 20manuals/books). i followed that chatbot guide on the doc page and it works. The issue: sometimes the "conversational" part will answer instead of the "expert" part.How can i make it so that the expert part answers all the domain-specific questions? I split my manuals by categories and created indexes based on that. Thanks!
I'm guessing you are using langchain with llama index as a tool?
The honest answer is that the only control you have is writing a better description for the tool, because that's how the LLM decides to use the tool or not 🤔
Yea you could add that to the agent prompt. Like "If you don't think you need to use a tool, respond saying you can't answer that right now" or something like that?
