Find answers from the community

Updated 5 months ago

Openai

At a glance

The community member is asking if the OpenAIAgent is meant for OpenAI models only, as they have tried using it with other local chat models like Mixtral, but the tools/functions do not appear to work. In the comments, another community member suggests that since the OpenAIAgent uses OpenAI's tools API, the community member should use the React agent for other models. Another community member wonders if the LiteLLM proxy has a way to translate OpenAI tool calls to an open-source backend, or if the community member needs to do something else.

Hi, is OpenAIAgent meant for openai models only? I tried several local chat models like mixtral but they do not appear to be able call any of the tools/functions.
L
z
2 comments
Yes, since it uses openais tools api

You should use the react agent for other models
I wonder if litellm proxy has some magic of translating openai tool calls to open-source backend, or if it expects you to do something else
Add a reply
Sign up and join the conversation on Discord