Find answers from the community

Updated 9 months ago

It' now clear why tree_summarize goes

It' now clear why tree_summarize goes back to the LLM so many times
L
j
4 comments
also, the type of index matters too

SummaryIndex sends every node to the LLM
VectorStoreIndex sends the top k (default is 2) chunks
if the retrieved nodes don't fit into a single LLM call, then it will do multiple in order to let the LLM read all the retrieved data
Thanks - very useful to understand this
Add a reply
Sign up and join the conversation on Discord