Find answers from the community

Updated 3 months ago

Hi all, I am trying to do a basic RAG

Hi all, I am trying to do a basic RAG with retrieval using Pinecone integration. When I have top k = 1, it returns 1 results; when I have top k = 3, it returns 1 as well; but wehn I have top k = 5, it returns 2. Does anyone know why?

Attachment

5 comments

LLogan M

Oh I've seen this before

LLogan M

You might have duplicate data in your vector db

LLogan M

Theres a step after retrieval where it uses content hashes to de-duplicate

LLogan M

If you try with a fresh vector store, freshly inserted with non-duplicate data, I bet it would work

EEmi

Thank you!

Add a reply