Find answers from the community

Updated 3 months ago

ReactAgent

ReActAgent writes the following to the console and stops further performing its work:

The current language of the user is: Kazakh. I need to use a tool to help me answer the question.
Action: document_search
Action Input: {"input": "Абайдың қырық үшінші қара сөзі"}

Why is this happening?

6 comments

WWhiteFang_Jr

Open-source llms are not good at agentic stuff. You'll have to do a lot of hit and trial to make it working by modifying the prompt , adding more description

WWhiteFang_Jr

Plus since your language is not English you'll have to check how good your llm is at understanding your language

AAbdymazhit

My stack:

llm: gemma2-27B-instruct-fp16
embed: Alibaba-NLP/gte-Qwen2-1.5B-instruct
agent: ReActAgent
vector store: chroma
text splitter: SentenceSplitter(chunk_size=1024, chunk_overlap=150)

When I do common tasks with ReActAgent, it performs well. When it comes to RAG, the results get significantly worse. Are there ways to improve the result? Currently, the Query Engine Tool returns the wrong result from the document to the user's request

ppikachu8887867

@Abdymazhit does your embedding model support Kazakh language?

AAbdymazhit

Yes, it has support

ppikachu8887867

I would recommend to start with simple architecture first and then try agents

Add a reply