How would you approach the whole query decompose part? I don't know if the query will be complex or straight forward, is there a way (like the agents in langchain) to let the LLM decide what approach is needed given a query?
Yea definitely. Using multiple indexes as custom "tools" in langhchain is a pretty powerful pattern. Then, you just need to write tool descriptions so that langhchain pick the right tool for the job 🙂
