Find answers from the community

Updated 2 months ago

I'm just trying to pass text directly to

nnbulkz

I'm just trying to pass text directly to a Longformer model using SummaryIndex I think.

5 comments

LLogan M

Yea you can

LLogan M

ServiceContext.from_defaults(llm=llm, embed_model=None)

nnbulkz

ok, that makes sense. Does it make sense to not use embeddings if every "query" is dynamically related to the .pdf passed immediately?

LLogan M

Embeddings are needed if you want to do top-k retrieval

Using a summary index, every node/chunk from the PDF will be itertively sent to the LLM (good for summaries, not as good for QA)

nnbulkz

I think I do want every node/chunk

Add a reply