Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Rate limits
Rate limits
Inactive
0
Follow
k
kittenkill
last year
Β·
Hi!, im getting 'Rate limit reached for 10KTPM-200RPM' errors when using gpt-4. Should LlamaIndex take into consideration the limit's, and sleep between calls? or thats something i'll need to do at the app side?
L
k
2 comments
Share
Open in Discord
L
Logan M
last year
We do have some basic retry logic, but the values (wait time and number of retries) are hard-coded.
Would be a nice PR to make these user configurable π
I think you'll have to manage it on the app side it looks like otherwise
k
kittenkill
last year
all right, thanks for the info!
Add a reply
Sign up and join the conversation on Discord
Join on Discord