hey @Logan M @disiok

SSiddhant Saurabh

hey
We have been trying DocumentSummaryIndex, but found out this particular problem
eg. before inserting we had 25 no. of nodes but DocumentSummaryIndex inserted only one node in the pinecone
have attached the code for inserting nodes, the runtime output for on of nodes while inserting is 25 and the actual no. of nodes inserted (is only 1)
currently we are using latest llama_index 0.9.25.post1
Have you come acrossing this before? Can you please tell me how come only one node is getting inserted? Am I missing some parameters?

Attachments

3 comments

LLogan M

Did all the nodes come from the same parent document?

LLogan M

the document summary index works by grouping nodes according to their parent document

A summary is generated for every unique parent document, and that is also what is embeded and used for retrieval.

So, if all nodes come from the same document, only one summary would be created and inserted. The rest of the nodes live in the docstore

SSiddhant Saurabh

so a summary node + all the nodes needed to be uploaded (in total 1+25)

the list of nodes given in DocumentSummaryIndex, contains documents from the same document, all had the same doc_id.

do I need to update the relationship parameter too for every node?

Add a reply

Find answers from the community

hey @Logan M @disiok