Find answers from the community

Updated 5 months ago

Can a ContextChatEngine be made using

At a glance

The community members are discussing the possibility of creating a ContextChatEngine using QueryPipelines. One community member suggests that it is possible, outlining a process of retrieving data, feeding it to a prompt template that pulls from retrieved nodes and chat history, and then running it through a large language model (LLM). Another community member notes that the chat history/memory might need to be a custom component, but that it would be easy to implement.

Can a ContextChatEngine be made using QueryPipelines?
L
2 comments
this is one of the things on my todo list to make

I feel like its possible though -- just retrieve, feed to a prompt template that pulls from retrieved nodes + chat history, then run through an LLM
the chat_history / memory might have to be a custom component at the moment (easy enough to do tho)
Add a reply
Sign up and join the conversation on Discord