Find answers from the community

J
James
Offline, last seen 6 months ago
Joined September 25, 2024
i'm working on a RAG app using LlamaIndex / llamacpp server / vectorpg / flask / react+ typescript chat UI

i've got a prototype working that:
  1. uses a custom VectorDBRetriever to retrieve first batch of nodes with scores
  2. response_syntheziser with custom prompt text_qa_template
  3. RetrieverQueryEngine that uses SentenceTransformerRerank
  4. and finally generating response via CondenseQuestionChatEngine.
problem: i'm unable to figure out how to roll in chat history so that the app functions like a true chat bot.

are there any documents / tutorials / code bases that would be a good reference to help me figure out this last piece?
4 comments
J
L