Find answers from the community

Updated 6 months ago

Cancelled

At a glance

A community member created a FastAPI endpoint using LlamaIndex, but when making parallel calls to the retriever, the event loop is getting terminated. Another community member suggested installing aynio==4.2.0 as a solution, but the issue persists even after the installation. The community members are unsure of the underlying cause and suggest debugging the full error and any other issues that may be causing the event loop to get canceled.

ssarath_sk

Hi everyone, I created fastapi endpoint using llama index but when I make parallel calls to retriever the event loop is getting terminated, did anyone face issue like this

4 comments

LLogan M

I did see this the other day with someone else. The solution was to install aynio==4.2.0

Usually though if the even loop gets canceled, there's so other underlying error happening

ssarath_sk

Okay let me try installin aynio and what needs to be done

ssarath_sk

It’s already installed still throwing the same error

LLogan M

So something else that's running async is causing the loop to get canceled then... this is pretty hard to debug ngl

What's the full error? Is there anything else before the error that goes wrong?

This might take some hard-core debugging to figure out

Add a reply