Find answers from the community

Updated 6 months ago

Parallel run of recursive_query_engine

At a glance

The community member is having trouble running 20 parallel calls to the recursive_query_engine in a Jupyter notebook, as the calls are running synchronously instead of in parallel. The comments suggest that the issue is that the community member is not using an asynchronous query, and that they should use await recursive_query_engine.aquery(...) instead of the regular query() method. The comments indicate that aquery() is the asynchronous version of the query method.

Parallel run of recursive_query_engine not working in jupyter notebook. Im looking to run 20 recursive_query_engine calls in parallel to lower latency of my project but it is still running synchronously.
Attachment
Screenshot_2024-03-27_at_11.09.34_AM.png
L
l
6 comments
you aren't using an async query
so it is blocking
response = await recursive_query_engine.aquery(...)
should be that
will try now, thanks... is it aquery? or just query? @Logan M
its aquery for async
Add a reply
Sign up and join the conversation on Discord