Find answers from the community

Updated 3 months ago

Hi all, I am trying to do a basic RAG

Hi all, I am trying to do a basic RAG with retrieval using Pinecone integration. When I have top k = 1, it returns 1 results; when I have top k = 3, it returns 1 as well; but wehn I have top k = 5, it returns 2. Does anyone know why?
Attachment
Screenshot_2024-02-19_at_3.21.10_PM.png
L
E
5 comments
Oh I've seen this before
You might have duplicate data in your vector db
Theres a step after retrieval where it uses content hashes to de-duplicate
If you try with a fresh vector store, freshly inserted with non-duplicate data, I bet it would work
Add a reply
Sign up and join the conversation on Discord