how to query one specific index from multiple available
how to query one specific index from multiple available
At a glance
The community member has about 1000 documents with technical hardware specifications, where each document has a separate index created and one document has around 100-150 pages. They are looking for the best recommended implementation to allow them to use only the index that has the specific information they need, instead of querying all indexes. The community members discuss different query engine options, such as RouterQueryEngine, SubQuestionQueryEngine, and QueryFusionRetriever, but there is no explicitly marked answer.
I'm having about 1000 documents with technical hardware specifications, where each document have a separate index created and one document have around 100-150 pages. What will be best recommended implementation to allow me when I have a question about a specific model, to be used only the index that will have that specific information and not query on all indexes ? Thanks
@Logan M @WhiteFang_Jr any recommendation ? I was thinking to use SubQuestionQueryEngine and Tools there is a better option ? Btw, there is a limitation in numbers of tools we can create ? Thanks
@WhiteFang_Jr if I understand correctly as a comparation using RouterQueryEngine will select for final response only one data source, and if I use SubQuestionQueryEngine will have more sub questions only for specific relevant data source? And using multi-index QueryFusionRetriever will query over all data source in the same time ?
RouterQueryEngine: It picks the index based on the description provided to each index. Subquestion: It will generate subquestions for the tool which gets picked from the description. QueryFusion: It will retrive nodes from all the index and then rerank them and then return the highest order nodes