Find answers from the community

Updated 7 months ago

Hello, I’m using the mistral API and

Hello, I’m using the mistral API and when I run it in async while streaming I get this weird bug, it only happens on odd request, for example 1: works, req 2: fail, req 3: works and so on
runtimeError: Event loop is closed

8 comments

LLogan M

hmm usually event loop is closed means another error happened

LLogan M

although async has a habit of swallowing errors too

TThomas1234

It happens when I’m using the chat engine with astream, the weird part for me is that is only happened to me with the mistral API, never happened when i was using vllm

TThomas1234

I could send the trace back but it’s quite long, I’m trying to find where’s the problem but I’m having an hard time finding it

LLogan M

I'm fine with huge tracebacks haha

TThomas1234

It's too big for discord, I'm sending a txt hopes it's fine 🙂

TThomas1234

@Logan M i made a PR that seems to fix the issue, I’ve got some linting issues, which linger are you using ?

LLogan M

pre-commit should be doing all the linting for you if its installed 👀 I can take a look as well (thank you for the PR!)

Add a reply