Find answers from the community

Updated 2 months ago

ReAct or any of the other ways that the

ReAct or any of the other ways that the agents features are integrated with llamaindex. I'm using anyscale mixtral model, which is capable of functin calling, but I can't even test it with llamaindex bc it doesn't expect it to have is_function_calling_model=True

8 comments

LLogan M

Ah yea, we need to change how we check for is_function_calling_model in the code.

And even then, it really only works for APIs that copy openais API

jjoaquind

fortunately, it seems like Anyscale does have an OpenAI syntax, which is why I figured the functionality would be interchangeable : https://docs.endpoints.anyscale.com/examples/work-with-openai

LLogan M

it technically should be then, using:

llm.metadata.is_function_calling_model=True

LLogan M

and then passing the LLM in

LLogan M

agent = OpenAIAgent.from_tools(tools, llm=llm)

jjoaquind

Yeah, I tried that, but it seems to be hardcoded to not let that value change.

Attachment

LLogan M

Hmmmm

jjoaquind

I tried using the base OpenAI() llm class and changing the api_base and model, but got "unknown model" :/.

Add a reply