Find answers from the community

Updated 3 months ago

Api

I've been stuck on llama index 0.8.64 since the package for openai 1.0 got released because it didn't support azure open ai with SubQueryEngine -> API calls would fail. Was wondering if that issue is gone now.

6 comments

LLogan M

Azure works fine with sub question query engine. But for whatever reason you need to use at least 2023-07-01-preview, and newer versions of the LLM model

Microsoft is whack lol

cchantlong

Newer version of the LLM model?

Looking at this page 0613 has been the default for a long time.
You referring to gpt-4 (1106-preview) ?
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models

cchantlong

The functional calling supported by 2023-07-01 is when I use stuff that deal with Tools(funciton calling) like the SubqueryEngine so if I just use a normal Retriever the API version and model wouldn't matter in the newer versions of LlamaIndex right?

LLogan M

Yea like the 1106 version. For whatever reason Microsoft didn't update the api to support to new tool format for the base version

cchantlong

oh... Japan doesn't support 1106 yet 🥹

LLogan M

Oh dang 😅 I think 3.5 works out of the box (although you take the hit I'm ability compared to gpt 4)

Add a reply