Find answers from the community

Updated 3 months ago

does anyone have any advice on the react

does anyone have any advice on the react-agent when with some LLMS it typically responds a lot with "Thought: (Implicit) I can answer without any more tools!" even if it then goes on to provide me a garbage answer..for example i ask for an example of code from my documentation and instead it outputs a a similar java example (not even the same language i asked for the example in)
L
R
3 comments
most open source LLMs are just really bad at being an agent imo. Llama3-70B is just barely good enough for example

You can try and provide more instructions to the model in the react prompt
ah youre correct, adding more information made it work 2/5 times, but honestly seems weirdly unstable in terms of repeating the same tool calls each time
Sounds about right tbh -- open source LLMs are really bad at being agents, trust
Add a reply
Sign up and join the conversation on Discord