hi i am trying to build a chatbot using

At a glance

A community member is trying to build a chatbot using OpenAI on Azure, but is encountering an error when trying to use the AzureOpenAI API. The error is related to the "functions" argument, which the community member is unsure if it is supported by the Azure GPT-4 model. The community members discuss the issue, with some suggesting that the function calling API may not be supported yet, and others trying to find the correct API version to use. Eventually, a community member finds that updating to LlamaIndex 0.7.13 and using the 2023-07-01-preview API version resolves the issue.

Useful resources

ffailfast

hi, i am trying to build a chatbot using openai on azure. i am following these instructions: https://gpt-index.readthedocs.io/en/latest/examples/agent/openai_agent.html. i've replaced this line:

Plain Text

llm: OpenAI = OpenAI(temperature=0, model="gpt-3.5-turbo-0613"),

with this:

Plain Text

llm: AzureOpenAI = AzureOpenAI(engine="gpt-4", model="gpt-4", temperature=0.7, max_tokens=800, top_p=0.95, frequency_penalty=0, presence_penalty=0, stop=None),

but I am getting this error:

Plain Text

openai.error.InvalidRequestError: Unrecognized request argument supplied: functions

in this line:

Plain Text

ai_message = self._llm.chat(chat_history, functions=functions).message

does anything immediately jump out? am i able to simply switch the llm to use AzureOpenAI?

12 comments

LLogan M

does gpt-4 in azure support the function calling API yet? I actually have no idea lol

ffailfast

ahh probably not

ffailfast

i'll check with them...

ffailfast

looking at their repo, looks like they added functions yesterday... trying to find which version to use https://github.com/Azure/azure-rest-api-specs/tree/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference

ffailfast

used 2023-07-01-preview but still getting same error unfortunately

LLogan M

seems like it's not really supported then right now 🤔 Might have to wait for proper support or just use normal openai for now

ffailfast

@Logan M FYI Azure released functions yesterday. I am still getting the same error I was getting previously though. Haven't spent too much time troubleshooting ibut might be that Llama index has to make a few changes for it to work with Azure

ffailfast

https://techcommunity.microsoft.com/t5/azure-ai-services-blog/function-calling-is-now-available-in-azure-openai-service/ba-p/3879241

LLogan M

Yea I can try to look into this 👍

BBrian Gardner

I'm getting the same error 😦

BBrian Gardner

Looks like updating to llamaindex 0.7.13 and using the 2023-07-01-preview API Version works

LLogan M

yup! We just fixed this!

Add a reply

Find answers from the community

hi i am trying to build a chatbot using