Find answers from the community

Updated 4 months ago

how to query one specific index from multiple available

At a glance
The community member has about 1000 documents with technical hardware specifications, where each document has a separate index created and one document has around 100-150 pages. They are looking for the best recommended implementation to allow them to use only the index that has the specific information they need, instead of querying all indexes. The community members discuss different query engine options, such as RouterQueryEngine, SubQuestionQueryEngine, and QueryFusionRetriever, but there is no explicitly marked answer.
Useful resources
I'm having about 1000 documents with technical hardware specifications, where each document have a separate index created and one document have around 100-150 pages. What will be best recommended implementation to allow me when I have a question about a specific model, to be used only the index that will have that specific information and not query on all indexes ? Thanks
A
W
5 comments
@Logan M @WhiteFang_Jr any recommendation ? I was thinking to use SubQuestionQueryEngine and Tools there is a better option ? Btw, there is a limitation in numbers of tools we can create ? Thanks
I think a RouterQueryEngine will be the best wat to go here: https://docs.llamaindex.ai/en/stable/module_guides/querying/router/root.html#routers

Define the index and provide a GOOD description that can help to pick the index
@WhiteFang_Jr if I understand correctly as a comparation using RouterQueryEngine will select for final response only one data source, and if I use SubQuestionQueryEngine will have more sub questions only for specific relevant data source? And using multi-index QueryFusionRetriever will query over all data source in the same time ?
@WhiteFang_Jr @Logan M can you confirm this ?
RouterQueryEngine: It picks the index based on the description provided to each index.
Subquestion: It will generate subquestions for the tool which gets picked from the description.
QueryFusion: It will retrive nodes from all the index and then rerank them and then return the highest order nodes
Add a reply
Sign up and join the conversation on Discord