Find answers from the community

Updated 8 months ago

Hey All, I'm having some difficulty with

Hey All, I'm having some difficulty with rate limiting when I'm indexing. I'm working on a project where i'm indexing hundreds of documents and even when I set num_workers to 1, OpenAI it starts returning 429s. How are y'all handling that?
L
M
4 comments
you can incrementally insert nodes at a slower pace
index.insert_nodes(nodes)
in batches with a sleep, for example
Thanks @Logan M. I will give it a shot!
Add a reply
Sign up and join the conversation on Discord