I'm getting an error about embed rate limits from Azure OpenAI that I wasn't getting before, and openai seems to say to tell me I have to wait 24hrs. This is with a embed batch size of 500. Doesn't happen with size 100.
However, I didn't have to wait 24 hours. I just reduced batch size and it worked.
Unanswered questions:
- Did Azure OpenAI recently reduce max batch size?
- Why does it say 86400s when it's not true?
2024-06-06 14:54:59,932 - llama_index.embeddings.openai.utils - WARNING - Retrying llama_index.embeddings.openai.base.get_embeddings in 0.6736039165786247 seconds as it raised RateLimitError: Error code: 429 - {'error': {'code': '429', 'message': 'Requests to the Embeddings_Create Operation under Azure OpenAI API version 2024-02-15-preview have exceeded call rate limit of your current OpenAI S0 pricing tier. Please retry after 86400 seconds. Please go here: https://aka.ms/oai/quotaincrease if you would like to further increase the default rate limit.'}}.