what llama model works with the Function

currently openai, anthropic, mistral, and text generation inference

basically the LLM needs to provide an API for tool usage

all other LLMs should use something prompt based, like react

does that include Anthropic through Bedrock as well?

No, because amazon is 💩

They have their own weird function calling thing that I haven't looked into integrating yet

I agree it sucks, some of us are forced to use it for the time being unfortunately!