Find answers from the community

Updated 8 months ago

Hey guys, my react agent keeps trying to

At a glance

The community member is experiencing an issue with their React agent, where it keeps trying to call tools that don't exist, causing issues with the memory buffer. The comments suggest that the community member is using a smaller open-source language model (Llama 7b) which may be the cause of the problem, as smaller LLMs tend to "hallucinate" more. The community members recommend exploring ways to improve the prompts, adding strict instructions, and providing more description to the tools to mitigate the issue, but there is no explicitly marked answer.

Hey guys, my react agent keeps trying to call tools that don’t exist and it screws up then whole memory buffer. Why would this be happening?
W
Y
5 comments
Are you using open source llm?
small Open-source llms are not that great at handling these agent kind of stuff
Llama 7b , yes
Am I purely being bottlenecked by the llm?
Kind of Yeah
You can explore adding more description to your prompts, adding strict instructions and also add more description to your tools.

Smaller llms tends to hallucinate a lot, see if the above change works
Add a reply
Sign up and join the conversation on Discord