Azure openai path settings issue with query parameter

BBerndPra

I would appreciate some help with AzureOpenAI path settings. Our proxy requires a path like https://ai-proxy.lab.mycompany.com/openai/deployments/gpt-35-turbo-1106/chat/completions?api-version=2023-12-01-preview.
By setting OPENAI_API_BASE to https://ai-proxy.lab.mycompany.com/openai/deployments/gpt-35-turbo-1106 Llamaindex calls https://ai-proxy.lab.mycompany.com/openai/deployments/gpt-35-turbo-1106/chat/completions but the query parameter ?api-version=2023-12-01-preview is missing and the call fails. How can I add that? Thank you for any help.

5 comments

ccoder.ve

from llama docs:

https://docs.llamaindex.ai/en/stable/examples/customization/llms/AzureOpenAI/

BBerndPra

The only difference to that code is that I use from llama_index.llms.azure_openai import AzureOpenAI. Going to try from openai import AzureOpenAI per that example.

BBerndPra

That was it. Wrong import. Thank you.

BBerndPra

Celebrated too early: SchemaLLMPathExtractor does not work with the openai version.

BBerndPra

Developer dilemma: It's working now and I don't know why .... 👀 Thank you for your help though.

Add a reply

Find answers from the community

Azure openai path settings issue with query parameter