Find answers from the community

Updated 8 months ago

Hello! I have an Ingestion Pipeline

Hello! I have an Ingestion Pipeline which ingests WIkipedia articles, I set _id to be the URL? I'm using SUpabaseVectorStore and Postgres Docstore. It seems to ingest everything properly, however whem I ask a question (basically the title of one of the articles) I only get 1 or 2 NodeWithScore event to similarity_top_k=10, What might be wrong? (Tried with Qdrant similar results)

2 comments

LLogan M

Did you only ingest 1 or 2 nodes?

you can also confirm retrieval by using

Plain Text

retriever = index.as_retriever(similarity_top_k=10)
nodes = retriever.retrieve("query")
print(len(nodes))

TTheDorsan

I was lazy and used StringIterable Document Parser, but I only had one text, yet I did not pass a list of one strings, but the text itself, so it was chunked up to a bunch of docs. 5 hours of my life, I'll never get back. 🥹

Add a reply