LlamaIndex
Log in

Find answers from the community

Updated 8 months ago

Hey All, I'm having some difficulty with

MMike King
·
Hey All, I'm having some difficulty with rate limiting when I'm indexing. I'm working on a project where i'm indexing hundreds of documents and even when I set num_workers to 1, OpenAI it starts returning 429s. How are y'all handling that?
L
M
4 comments
LLogan M
you can incrementally insert nodes at a slower pace
LLogan M
index.insert_nodes(nodes)
LLogan M
in batches with a sleep, for example
MMike King
Thanks @Logan M. I will give it a shot!
Add a reply
Sign up and join the conversation on Discord