Find answers from the community

Updated 3 months ago

I'm just trying to pass text directly to

I'm just trying to pass text directly to a Longformer model using SummaryIndex I think.
L
n
5 comments
ServiceContext.from_defaults(llm=llm, embed_model=None)
ok, that makes sense. Does it make sense to not use embeddings if every "query" is dynamically related to the .pdf passed immediately?
Embeddings are needed if you want to do top-k retrieval

Using a summary index, every node/chunk from the PDF will be itertively sent to the LLM (good for summaries, not as good for QA)
I think I do want every node/chunk
Add a reply
Sign up and join the conversation on Discord