Find answers from the community

m
maik
Offline, last seen 3 months ago
Joined September 25, 2024
Hi all, I'm currently setting up a query engine in combination with a large vector database (Qdrant hosted in the cloud). Therefore, retrieval can take longer than 30 seconds. In this case, sync and async queries raise an error. I set in every possible subcomponent (embed_model, llm, query_engine, index, client) timeout / request_timeout > 30. How can I increase the retrieval time?
Trace: query
|_CBEventType.QUERY -> 30.18417 seconds
|_CBEventType.RETRIEVE -> 30.18417 seconds
|_CBEventType.EMBEDDING -> 0.155964 seconds

UnexpectedResponse: Unexpected Response: 504 (Gateway Time-out)
Raw response content:
b"<html><body><h1>504 Gateway Time-out</h1>\nThe server didn't respond in time.
4 comments
m
W
T