Find answers from the community

Updated 3 months ago

Agent with chat memory, tools, and streaming capabilities

I have an agent working using a ChatSummaryMemoryBuffer and a tool for vector search and some other tools based on FunctionCallingAgentWorker, which doesn't support streaming, is there an existing agent class that has chat_memory, tools and streaming? (maybe only streaming for the final response - that would be totally fine). Any multi-agent examples would also be interesting. I'm considering attempting to write an agent class that does all the stuff I'd like (context like the condense plus context chat engine, function calling, and streaming), but it's a bit complex. Thanks for any insight!
L
r
2 comments
Been meaning to add streaming to that agent. If you are using openai, you can just use OpenAIAgent

You can also build your own slightly more from scratch, which imo is way more interesting and useful in the long term (easier to customize). Here's one built with workflows, with async streaming + dynamic context retrieval
https://colab.research.google.com/drive/1wVCkvX7oQu1ZwrMSAyaJ8QyzHyfR0D_j?usp=sharing
Awesome, thanks!
Add a reply
Sign up and join the conversation on Discord