Find answers from the community

Updated 3 months ago

Hi everyone, how can i get the all nodes

Hi everyone, how can i get the all nodes from en existing pg vector store to use it for bm25 retriever? I've already tried to get it with:

Plain Text

index = VectorStoreIndex.from_vector_store(vector_store=vector_store)
nodes = index.docstore.docs.values()
print("nodes: ", nodes)

nodes: dict_values([])

It returns an empty dict even it has a value in the table

9 comments

WWhiteFang_Jr

Yeah the reason why it returns empty is because nodes are not present locally , they are stored in the vector stores.

You have the pg_client, Use that client to fetch all the data from vector store and then feed it to BM25

DDoğan

@WhiteFang_Jr Thank you so much, is there any examples or documents to get help? I'm new to llamaindex

DDoğan

I don't wnat to read the document every time i want to retrieve with bm25

WWhiteFang_Jr

Actually What I suggested in not implemented in PG vector store I think. 😅
But since you already have the client for PG vector store so its like DB connection client. You can use that and check on Postgress vector store official docs how they retrieve all the docs

WWhiteFang_Jr

Retrieve whole data and then feed it to BM25

DDoğan

Yeah i'm using pgvector

DDoğan

I don't know why is it too hard to get all nodes from the db 😄

WWhiteFang_Jr

Its not implemented as the core code only requires to fetch only the relatable items based on user query

DDoğan

@WhiteFang_Jr thank you

Add a reply