Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 8 months ago
0
Follow
Hey All, I'm having some difficulty with
Hey All, I'm having some difficulty with
Inactive
0
Follow
M
Mike King
8 months ago
ยท
Hey All, I'm having some difficulty with rate limiting when I'm indexing. I'm working on a project where i'm indexing hundreds of documents and even when I set num_workers to 1, OpenAI it starts returning 429s. How are y'all handling that?
L
M
4 comments
Share
Open in Discord
L
Logan M
8 months ago
you can incrementally insert nodes at a slower pace
L
Logan M
8 months ago
index.insert_nodes(nodes)
L
Logan M
8 months ago
in batches with a sleep, for example
M
Mike King
8 months ago
Thanks @Logan M. I will give it a shot!
Add a reply
Sign up and join the conversation on Discord
Join on Discord