Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Llama index keeps refining over and over
Llama index keeps refining over and over
Inactive
0
Follow
j
jay
10 months ago
Β·
Llama index keeps refining over and over. How do I make it stop?
L
j
7 comments
Share
Open in Discord
L
Logan M
10 months ago
Not sure what you mean. Can you share some code?
j
jay
10 months ago
Figured it out. Well.. mostly
j
jay
10 months ago
It's because of response mode settings
https://docs.llamaindex.ai/en/stable/module_guides/deploying/query_engine/response_modes.html
j
jay
10 months ago
When it's default, it refines something like 7-8 times so I have set it to simple_summarize
j
jay
10 months ago
is there a way I can set it to refine just once?
L
Logan M
10 months ago
I'm not sure what you mean π€ If it refines as much as it needs to read all retrieved context
To reduce the number of refines (if using a vector index), I would decrease the top-k
j
jay
10 months ago
Ah I see. Thank you π
Add a reply
Sign up and join the conversation on Discord
Join on Discord