Find answers from the community

Updated last year

Is there a way to manage rate limits

At a glance

Is there a way to manage rate limits with embeddings using azure, like can thing the embed batch size help?

4 comments

embed_batch_size will help if you lower it yea, default is 10

Wtf
I set it to 100 and it cleared out the errors lol

hmm.. that works too lmao

I guess less requests?

Add a reply