Find answers from the community

Updated 6 months ago

does anyone have any advice on the react

At a glance

The community member is experiencing issues with a react-agent and large language models (LLMs), where the LLMs often respond with the message "Thought: (Implicit) I can answer without any more tools!" and then provide a poor answer, such as an example in a different programming language than requested. The comments suggest that open-source LLMs are generally not well-suited for being agents, and that providing more instructions to the model in the prompt may help, but the results can still be unstable.

does anyone have any advice on the react-agent when with some LLMS it typically responds a lot with "Thought: (Implicit) I can answer without any more tools!" even if it then goes on to provide me a garbage answer..for example i ask for an example of code from my documentation and instead it outputs a a similar java example (not even the same language i asked for the example in)
L
R
3 comments
most open source LLMs are just really bad at being an agent imo. Llama3-70B is just barely good enough for example

You can try and provide more instructions to the model in the react prompt
ah youre correct, adding more information made it work 2/5 times, but honestly seems weirdly unstable in terms of repeating the same tool calls each time
Sounds about right tbh -- open source LLMs are really bad at being agents, trust
Add a reply
Sign up and join the conversation on Discord