Find answers from the community

Updated 5 months ago

"Should I create tools for every file

"Should I create tools for every file and save that in database?"
Hi,

I am building a RAG SaaS project where users will upload hundreds or thousands of PDFs, docs, and other file types. I need the agent to answer questions based on these documents. What is the most efficient way to create query engine tools for the agent?

  1. Should I provide the agent with a single query engine tool and indicate that it can handle any type of question?
  2. Alternatively, should I create and save separate query engine tools for each document upon upload and provide the agent with a list of these tools?
Additionally, does saving individual query engine tools for each document even work effectively?

Thank you for your help!
R
L
6 comments
look at metadata filtering
@Roland Tannous thanks for your answer , when the number of file is 1000 or 10000 which one is more efficient ? Metadatafilters or "creating a vector_query tool for each topic and in the tool's description specify which topic, each tool applies to"
the number of files is 1000, but what is the number of topics? much much less, right?
Another question , can we save vector_query tool in database ?
Add a reply
Sign up and join the conversation on Discord