The community member is having difficulty with rate limiting when indexing hundreds of documents, even when setting num_workers to 1, and is receiving 429 errors from OpenAI. The comments suggest that the community member can try incrementally inserting nodes at a slower pace, using index.insert_nodes(nodes) in batches with a sleep in between. One community member thanks another (@Logan M.) and says they will give it a shot.
Hey All, I'm having some difficulty with rate limiting when I'm indexing. I'm working on a project where i'm indexing hundreds of documents and even when I set num_workers to 1, OpenAI it starts returning 429s. How are y'all handling that?
