Log in
Log into community
Find answers from the community
View all posts
Related posts
Was this helpful?
π
π
π
Powered by
Hall
Inactive
Updated 7 months ago
0
Follow
does llama index support batching
does llama index support batching
Inactive
0
Follow
At a glance
a
andy
7 months ago
Β·
does llama index support batching requests? for example asking 32 questions in one request rather than 32 unique calls?
open ai has something like this:
https://platform.openai.com/docs/guides/rate-limits/error-mitigation
but not sure about llama index
L
1 comment
Share
Open in Discord
L
Logan M
7 months ago
not at the moment. Only async/concurrancy
Add a reply
Sign up and join the conversation on Discord
Join on Discord