Find answers from the community

Updated 4 months ago

Chat

I'm trying to manage many clients at once. How can I hotswap message histories with llamaindex? It seems like it expects to repeatedly use the same message history, and it's making me wonder if usecases where llamaindex is running on the server are expected or not supported, I haven't been able to find any exact documentation on this issue and the stack overflow question about it is unanswered.
L
2 comments
Chat engines and agents allow you to pass in and override chat history
agent.chat(msg, chat_history=chat_history)

Where chat history is a list of ChatMessage objects
So you can manage histories yourself, and make the chat engine/agent stateless
Add a reply
Sign up and join the conversation on Discord