Find answers from the community

Updated 4 months ago

OK, figured it out.

OK, figured it out.

By increasing the num_workers on the pipeline, and putting the pipeline into async mode per the instructions, the acall method is invoked.

This makes it possible to put all the await asyncio.gather() and create tasks into acall(). TaskGroups however do not seem to work due to some fault llamaIndex throws so gather is the only option.
L
2 comments
multiprocessing isn't worth the trouble because so many elements are not pickleable. I should honestly remove that option from the code
Async is by far the best way
Add a reply
Sign up and join the conversation on Discord