Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
I'm just trying to pass text directly to
I'm just trying to pass text directly to
Inactive
0
Follow
n
nbulkz
10 months ago
ยท
I'm just trying to pass text directly to a Longformer model using SummaryIndex I think.
L
n
5 comments
Share
Open in Discord
L
Logan M
10 months ago
Yea you can
L
Logan M
10 months ago
ServiceContext.from_defaults(llm=llm, embed_model=None)
n
nbulkz
10 months ago
ok, that makes sense. Does it make sense to not use embeddings if every "query" is dynamically related to the .pdf passed immediately?
L
Logan M
10 months ago
Embeddings are needed if you want to do top-k retrieval
Using a summary index, every node/chunk from the PDF will be itertively sent to the LLM (good for summaries, not as good for QA)
n
nbulkz
10 months ago
I think I do want every node/chunk
Add a reply
Sign up and join the conversation on Discord
Join on Discord