Find answers from the community

Updated 2 months ago

What are the key differences between

What are the key differences between index.as_query_engine() vs index.as_chat_engine()? I used my one pager bio as the document and compared these two with a few well known LLMs. I asked a few questions about myself via the one pager. The results are very different between them. The index.as_query_engine() approach did generally well with all these LLMs. However, index.as_chat_engine() has huge hallucination problem. Can someone provide insight about the huge differences?

1 comment

WWhiteFang_Jr

In short term

Query_Engine:
It queries your data and pass it to LLM and you get a response.

Chat Engine:
it is a stateful analogy of a Query Engine. By keeping track of the conversation history, it can answer questions with past context in mind.

So maybe past conversations are altering your queries in such a way that your final answer is getting hampered.

Read more here: https://docs.llamaindex.ai/en/stable/module_guides/deploying/chat_engines/root.html

Add a reply