LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Parallel run of recursive_query_engine

lln232033
·
Parallel run of recursive_query_engine not working in jupyter notebook. Im looking to run 20 recursive_query_engine calls in parallel to lower latency of my project but it is still running synchronously.
Attachment
Screenshot_2024-03-27_at_11.09.34_AM.png
L
l
6 comments
LLogan M
you aren't using an async query
LLogan M
so it is blocking
LLogan M
response = await recursive_query_engine.aquery(...)
LLogan M
should be that
lln232033
will try now, thanks... is it aquery? or just query? @Logan M
LLogan M
its aquery for async
Add a reply
Sign up and join the conversation on Discord