Find answers from the community

Updated 3 months ago

Is there a "dumb" model that is super

Is there a "dumb" model that is super fast and just finds matching vectors from a vectorstore database. like i give a prompt about something i want and it only does the query part without the inference.
W
R
2 comments
All the retreivers dont usually time unless you have huge amount of data and you are on CPU.

If you just want to retrieve the related nodes you need just the retriever part of the index only.

Plain Text
retriever = index.as_retriever()

response = retriever.retrieve("Which food is good")
But can it find the correct thing semantically too?
Add a reply
Sign up and join the conversation on Discord