Find answers from the community

Updated 3 months ago

AzureOpenAI

Looking at the docs posted by

Plain Text

llm = AzureOpenAI(
    engine="my-custom-llm",
    model="gpt-35-turbo-16k",
    temperature=0.0,
    azure_endpoint="https://<your-resource-name>.openai.azure.com/",
    api_key="<your-api-key>",
    api_version="2023-07-01-preview",
)

if you use the latest llama index & openai, did api_base get deprecated and became azure_endpoint ?
https://github.com/run-llama/llama_index/blob/main/docs/examples/llm/azure_openai.ipynb

2 comments

WWhiteFang_Jr

No, I think it is only done for Azure case. OpenAI still have api_base in it's class.
https://github.com/run-llama/llama_index/blob/9ba693d4913281795675e08bf5658a5ceb8f4ab4/llama_index/llms/openai.py#L76

LLogan M

Yea, just the way you instansiate azure has changed ever so slightly, since there was a new openai client released

Add a reply