Find answers from the community

Home
Members
terapapi
t
terapapi
Offline, last seen 4 months ago
Joined September 25, 2024
Hi can anyone point me to anexample for a local llm chat bot with following steps-
  1. Retrieve documents from qdrant store (done)
  2. Rerank retrieved results with cross encoder ( I saw an example of hugging face but not sure how to apply this to retrieved results)
  3. Create an llm with chat history and context. It will have a custom prompt to use chat history and context for answering
4 Put all of above in a continuous chat bot experience with ollama
2 comments
g
L