Find answers from the community

Updated 3 months ago

What's the difference between `astream_

What's the difference between astream_chat and stream_chat on a query_engine?
T
w
L
9 comments
Astream is the asynchronous version, for reference you can find them here: https://docs.llamaindex.ai/en/latest/api_reference/query/chat_engines.html#
ah mb, I meant to ask about astream-chat and achat
I notice the achat returns a union of the streaming and non-streaming
when would the streaming version be returned in the achat context?
where did you see that?
weird, that might be a bug
I can't think of why it's typed like that
every actual implementation of achat using that base class is typed to return AgentChatResponse (I just checked lol) --- so yea, just a bug/dead typing on the base class
Add a reply
Sign up and join the conversation on Discord