DocumentSummaryIndex
. SummaryIndex
basically pulls all the nodes and iterate over them one by one to form the final answer. This would increase the time taken to respond. DocumentSummaryIndex
is a one time effort that comes while building your index. Each Document object goes through LLM and and generates a summary against it.DocumentSummaryIndex
for a given document and shall i loop through all documents one by one or dump all of them and then print individual summary to a payload file while going through each doc_ID.SummaryIndex
as it's documentation is not detail rich (https://docs.llamaindex.ai/en/stable/api_reference/indices/summary/); like when you say 'pulls all the nodes', how do it does that, based upon summary or some filter/prompt tokens?.DocumentSummaryIndex
) despite the word Summary in it's name SummaryIndex
, correct? If correct, just curious, why to name it SummaryIndex?DocumentSummaryIndex
Before chunking documents into Nodes
, Summary is created over the whole Document and it is attached to the chunked nodes of that document. SummaryIndex
because it is touching all the nodes and not because it's summarizing all the nodes on backend like DocumentSummaryIndex
does? right?