Find answers from the community

Updated last year

Hello everyone, can you help me with

At a glance
Hello everyone, can you help me with this issue?
For the same query to the same query_engine, normally it takes 10 seconds to response but sometime it takes 10mins to retry, why is that?
T
l
2 comments
How often does this happen? Which LLM are you using?
I build a RouterQueryEngine pipeline, and test it on 50 questions. It happened at least 1 time per test round. I am using openai API. The WARNING info is as follows:
Plain Text
WARNING:llama_index.llms.openai_utils:Retrying llama_index.llms.openai_utils.completion_with_retry.<locals>._completion_with_retry in 4.0 seconds as it raised Timeout: Request timed out: HTTPSConnectionPool(host='api.openai.com', port=443): Read timed out. (read timeout=600).
Retrying llama_index.llms.openai_utils.completion_with_retry.<locals>._completion_with_retry in 4.0 seconds as it raised Timeout: Request timed out: HTTPSConnectionPool(host='api.openai.com', port=443): Read timed out. (read timeout=600).
Add a reply
Sign up and join the conversation on Discord