Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 5 months ago
0
Follow
does llama index support batching
does llama index support batching
Inactive
0
Follow
a
andy
5 months ago
ยท
does llama index support batching requests? for example asking 32 questions in one request rather than 32 unique calls?
open ai has something like this:
https://platform.openai.com/docs/guides/rate-limits/error-mitigation
but not sure about llama index
L
1 comment
Share
Open in Discord
L
Logan M
5 months ago
not at the moment. Only async/concurrancy
Add a reply
Sign up and join the conversation on Discord
Join on Discord