LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Speed

CChatGPT-fan
·
hi, guys, is it reasonable for llama chatbot to take 19 secs on average to make response? if not, what should i do to speed it up?? thanks....
L
C
2 comments
LLogan M
A lot of it depends on 1. How busy openai servers are and 2. How many llm calls one query takes (which depends on your index/query setup)
CChatGPT-fan
@Logan M thank u so much👍
Add a reply
Sign up and join the conversation on Discord