I used AzureOpenAIEmbedding with property graph index just fine and it started calling Azure OpenAPI for embeddings. Are you using below in the code? import nest_asyncio nest_asyncio.apply()
Also I used wrapper of LangchainEmbedding on AzureOpenAIEmbedding for optimizing batch calls.