Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 9 months ago
0
Follow
Hey All, I'm having some difficulty with
Hey All, I'm having some difficulty with
Inactive
0
Follow
M
Mike King
9 months ago
Β·
Hey All, I'm having some difficulty with rate limiting when I'm indexing. I'm working on a project where i'm indexing hundreds of documents and even when I set num_workers to 1, OpenAI it starts returning 429s. How are y'all handling that?
L
M
4 comments
Share
Open in Discord
L
Logan M
9 months ago
you can incrementally insert nodes at a slower pace
L
Logan M
9 months ago
index.insert_nodes(nodes)
L
Logan M
9 months ago
in batches with a sleep, for example
M
Mike King
9 months ago
Thanks @Logan M. I will give it a shot!
Add a reply
Sign up and join the conversation on Discord
Join on Discord