LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

How does one turn a Q&A RAG into a multi

vverdverm
·
How does one turn a Q&A RAG into a multi-turn chat experience?
  1. Initial question retrieves context
  2. Subsequent questions should continue with List[Message] like a chatbot, using the template & context as the system message?
T
v
4 comments
TTeemu
Have you tried the ChatEngine? https://docs.llamaindex.ai/en/stable/module_guides/deploying/chat_engines/root.html

https://docs.llamaindex.ai/en/stable/examples/chat_engine/chat_engine_context.html
vverdverm
Is that memory multi-user safe? I have this stuff running behind an API
vverdverm
I'm planning to persist chat history, so it might make sense to put the history in PSQL JSONB
vverdverm
Managed to get something working, thought I'd leave it here for anyone who comes along, the cache is not prod
Add a reply
Sign up and join the conversation on Discord