Find answers from the community

Updated 3 months ago

ReactAgent

ReActAgent writes the following to the console and stops further performing its work:

The current language of the user is: Kazakh. I need to use a tool to help me answer the question.
Action: document_search
Action Input: {"input": "Абайдың қырық үшінші қара сөзі"}

Why is this happening?
W
A
p
6 comments
Open-source llms are not good at agentic stuff. You'll have to do a lot of hit and trial to make it working by modifying the prompt , adding more description
Plus since your language is not English you'll have to check how good your llm is at understanding your language
My stack:
  • llm: gemma2-27B-instruct-fp16
  • embed: Alibaba-NLP/gte-Qwen2-1.5B-instruct
  • agent: ReActAgent
  • vector store: chroma
  • text splitter: SentenceSplitter(chunk_size=1024, chunk_overlap=150)
When I do common tasks with ReActAgent, it performs well. When it comes to RAG, the results get significantly worse. Are there ways to improve the result? Currently, the Query Engine Tool returns the wrong result from the document to the user's request
@Abdymazhit does your embedding model support Kazakh language?
Yes, it has support
I would recommend to start with simple architecture first and then try agents
Add a reply
Sign up and join the conversation on Discord