Find answers from the community

Updated 5 months ago

I am building a RAG with llamaindex and

At a glance

The community member is building a Retrieval Augmented Generation (RAG) system using llamaindex and wants to connect multiple modules, including a SQL query engine, vector search, keyword search, and image search (OpenAI CLIP). They are looking for guidance on how to build such a system with more than two retrievers. The comments suggest using a combination of different query engines handled with RouterQueryEngine or LLMMultiSelector to do all the searches simultaneously and then pass the results to a cohere reranker to get the final top_k results. There is no explicitly marked answer in the comments.

I am building a RAG with llamaindex and I need to connect multiple modules to get this working. I want to have a;
  1. SQL query engine
  2. Vector Search
  3. Keyword search
  4. Image search (OpenAI ClIP)
How can I build a system like this? I have seen examples but till now i couldn't find any examples having more than 2 retrievers.
W
H
2 comments
Maybe a combination of different query engines handled with RouterQueryengine ?
I just had a look at RouterQueryengine and I want to use LLMMultiSelector as I want to do all the searches simultaneously and then pass the results from each retriever to cohere reranker to get the final top_k results.

Is there any way to use multiple workers with RouterQueryEngine to speed up the process?
Add a reply
Sign up and join the conversation on Discord