Find answers from the community

Updated 7 months ago

Hello, I’m using the mistral API and

Hello, I’m using the mistral API and when I run it in async while streaming I get this weird bug, it only happens on odd request, for example 1: works, req 2: fail, req 3: works and so on
runtimeError: Event loop is closed
L
T
8 comments
hmm usually event loop is closed means another error happened
although async has a habit of swallowing errors too
It happens when I’m using the chat engine with astream, the weird part for me is that is only happened to me with the mistral API, never happened when i was using vllm
I could send the trace back but it’s quite long, I’m trying to find where’s the problem but I’m having an hard time finding it
I'm fine with huge tracebacks haha
It's too big for discord, I'm sending a txt hopes it's fine 🙂
@Logan M i made a PR that seems to fix the issue, I’ve got some linting issues, which linger are you using ?
pre-commit should be doing all the linting for you if its installed 👀 I can take a look as well (thank you for the PR!)
Add a reply
Sign up and join the conversation on Discord