Find answers from the community

Updated 3 months ago

Hey folks, I have a question when it

Hey folks, I have a question when it comes to a ReaAct agent (in this case a chat engine) - it doesn't seem to me like there is an elegant way to stream all events, including inner thoughts. When I set up a response stream I only get the final answer streamed. Peeking into the implementation it seems like the main ReaAct loop runs before the response stream is even created and returned, leading to the behavior that one may wait quite a bit before getting the final response. I'm wondering if there is something I'm missing? I got around it for now by implementing a callback handler that streams all the inner loop thoughts as well, but it seems a bit hacky. Any ideas on better ways to do this?
M
1 comment
Maybe the answer is to implement the ReAct agent myself and hook into all of the underlying tools and response streams that way?
Add a reply
Sign up and join the conversation on Discord