LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

Are there some methods for speeding up

ssysfor
·
Are there some methods for speeding up synthesize? the llm calls within synthesize are the most timely in my rag when looking at tracing via phoenix
L
1 comment
LLogan M
Only way to speed it up is to get a faster LLM 😉 Or decrease the amount of data being sent to the LLM (chunk size/top-k)
Add a reply
Sign up and join the conversation on Discord