LlamaIndex
Log in

Find answers from the community

Updated 6 months ago

For document summary index, can I use

At a glance
UUtine
·
For document summary index, can I use other model instead of GPT to generate summary? Like "pszemraj/long-t5-tglobal-base-16384-book-summary" in huggingface
W
U
L
4 comments
WWhiteFang_Jr
Yes you can, Just need to update llm and embed_model in the service_context with your choice of llm.
UUtine
Okay, good! Thank you👍
LLogan M
(t5 is probably not what you want to use for embeddings tho)
UUtine
There are llm and embed_model settings in ServiceContext. I set llm with T5 and embed_model with OpenAI embedding.
Add a reply
Sign up and join the conversation on Discord