Find answers from the community

Updated 5 months ago

Tpm

At a glance

The post asks how to limit TPM (Transactions Per Minute) and RPM (Requests Per Minute) in LlamaIndex. A community member responds that it cannot be done automatically, and the user will have to limit how quickly new documents are indexed or how quickly queries are made.

how to limit TPM and RPM in llamaindex ?
L
M
2 comments
You cant, at least not automatically. You'll have to limit how quickly you index new docs or how quickly you query things
Add a reply
Sign up and join the conversation on Discord