`INFO openai error code rate limit

bbmax

INFO:openai:error_code=rate_limit_exceeded error_message='Rate limit reached for gpt-4 in organization org-4TyujAPAwHUpADHfmELtxusc on tokens per min. Limit: 10000 / min. Please try again in 6ms. Contact us through our help center at help.openai.com if you continue to have issues.' error_param=None error_type=tokens message='OpenAI API error received' stream_error=False

Any solutions besides sending in less tokens and or adding a sleep (Which I don't think will help since 1 document is causing this)??

7 comments

LLogan M

I'm guessing that one document must be over 10000 tokens? 😅

What kind of task are you doing? Can you break the document into smaller chunks to avoid rate limits?

bbmax

It’s just an html page as one document. I’m stripping a lot of the html page out too

bbmax

I’m also doing two vector indexes.

bbmax

If I make it multiple smaller documents instead of 1 large documents does that help? I thought underneath document it splits it up into many nodes anyways.

LLogan M

Yea, just if you split it up beforehand you can put some time.sleep in there to make it not rate limit lol

bbmax

And have you heard of any success of people getting their rate limit increased?

LLogan M

I have! But it can take a while -- they won't raise it until you've been hitting rate limits lol

Add a reply

Find answers from the community

`INFO openai error code rate limit