Hello, I’m using the mistral API and when I run it in async while streaming I get this weird bug, it only happens on odd request, for example 1: works, req 2: fail, req 3: works and so on runtimeError: Event loop is closed
It happens when I’m using the chat engine with astream, the weird part for me is that is only happened to me with the mistral API, never happened when i was using vllm