Find answers from the community

Home
Members
TheDorsan
T
TheDorsan
Offline, last seen 3 months ago
Joined September 25, 2024
Hey! I have a newbie question.
I'M relatively new to VectorStores. What I want is accumulate data over time. (just like ReBuff, when checking for Prompt Injection), however, I do not want to overwrite, if something already exists.
I have a rag pipeline, that gathers information and inserts it into an external vector store, but it is dynamic, so I'm not sure if something exists or not, and would not want to waste resources!
Thanks! Glad to be here!
5 comments
L
T
Hello! I have an Ingestion Pipeline which ingests WIkipedia articles, I set _id to be the URL? I'm using SUpabaseVectorStore and Postgres Docstore. It seems to ingest everything properly, however whem I ask a question (basically the title of one of the articles) I only get 1 or 2 NodeWithScore event to similarity_top_k=10, What might be wrong? (Tried with Qdrant similar results)
2 comments
T
L
T
TheDorsan
·

Hey!

Hey!
I've just noticed this
https://docs.llamaindex.ai/en/stable/api_reference/storage/docstore/postgres/
I'm a little bit confused however.. since it says "mongodb" in the docs and docstring as well.
Does that mean, I can use Supabase as VectorStore and Docstore as well?
3 comments
T
L
T
TheDorsan
·

Query

Hey! I have a question, regarding this tutorial: https://docs.llamaindex.ai/en/stable/examples/retrievers/auto_merging_retriever
So, how would I go about querying the leaf nodes from an external vector database?
Query all the nodes, and get the leaf nodes? That sounds a bit expensive in terms of computation.
7 comments
L
T