Find answers from the community

Updated 9 months ago

I have a private dataset in a

I have a private dataset in a vectorsearch database which I can query fine using a chat engine in "context" mode but i get hallucinations when chat engine is switched to "best" or "ReAct" mode. Any advice on how to address this?

2 comments

WWhiteFang_Jr

You can try forcing the chat engine to use query engine while looking up for answer. That way it wont hallucinate: https://docs.llamaindex.ai/en/stable/examples/chat_engine/chat_engine_openai/#force-chat-engine-to-query-the-index

In case of Open-source, react might not work in case LLM is not very good at handling instructions to use query engine or not.

SShayan

Thank you, I can force OpenAI agent to use the tool but the tool returns empty. If I switch back to local chat engine in context mode, I get some results.

Add a reply