I'm having about 1000 documents with technical hardware specifications, where each document have a separate index created and one document have around 100-150 pages. What will be best recommended implementation to allow me when I have a question about a specific model, to be used only the index that will have that specific information and not query on all indexes ? Thanks
@Logan M @WhiteFang_Jr any recommendation ? I was thinking to use SubQuestionQueryEngine and Tools there is a better option ? Btw, there is a limitation in numbers of tools we can create ? Thanks
@WhiteFang_Jr if I understand correctly as a comparation using RouterQueryEngine will select for final response only one data source, and if I use SubQuestionQueryEngine will have more sub questions only for specific relevant data source? And using multi-index QueryFusionRetriever will query over all data source in the same time ?
RouterQueryEngine: It picks the index based on the description provided to each index. Subquestion: It will generate subquestions for the tool which gets picked from the description. QueryFusion: It will retrive nodes from all the index and then rerank them and then return the highest order nodes