Has anyone here used async streaming (astream_chat()) apis?
Currently facing some issues. I have a bot where I dynamically decide to either use the simple chat engine or the condense question chat engine (basically if the user says thank you or any sych greeting, no point in running retrieval for that)
I have some custom code to handle the streaming. Problem is when I use
response = chat_engine.stream_chat(user_message)
both chat engines work fine but when I switch to
response = await chat_engine.astream_chat(user_message)
I do not get a response from simple chat engine (but the condense question chat engine works)
Trying to figure out what might be going wrong.
if anybody knows of any resources that talks about async streaming that would be helpful as well
cc
