Find answers from the community

Updated 5 months ago

How does one turn a Q&A RAG into a multi

At a glance

The community member is asking how to turn a Q&A RAG (Retrieval Augmented Generation) into a multi-turn chat experience, where the initial question retrieves context and subsequent questions continue the conversation like a chatbot, using the template and context as the system message.

In the comments, another community member suggests trying the ChatEngine, providing links to relevant documentation. Another community member asks if the ChatEngine's memory is multi-user safe, as they have this running behind an API. A third community member mentions planning to persist the chat history in a PSQL JSONB database. Finally, a fourth community member states that they have managed to get something working, but notes that the cache is not for production use.

There is no explicitly marked answer in the provided information.

Useful resources
How does one turn a Q&A RAG into a multi-turn chat experience?
  1. Initial question retrieves context
  2. Subsequent questions should continue with List[Message] like a chatbot, using the template & context as the system message?
T
v
4 comments
Is that memory multi-user safe? I have this stuff running behind an API
I'm planning to persist chat history, so it might make sense to put the history in PSQL JSONB
Managed to get something working, thought I'd leave it here for anyone who comes along, the cache is not prod
Add a reply
Sign up and join the conversation on Discord