Find answers from the community

Updated 4 months ago

Using openai batch api in document summary index

At a glance

The community member asks if there is a way to use the OpenAI Batch API in the Document Summary Index feature of the llama-index library. Another community member responds that this is not possible, as the llama-index library is designed to avoid tasks that take a long time to run, unlike the OpenAI Batch API.

Useful resources
Is there way to use the OpenAI Batch API in Document Summary Index (https://docs.llamaindex.ai/en/stable/examples/index_structs/doc_summary/DocSummary/) ?
Attachment
image.png
L
1 comment
There is not -- almost all the of llama-index library is built around things not taking 24 hours to run πŸ˜…
Add a reply
Sign up and join the conversation on Discord