Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Also is there a small to big indexing /
Also is there a small to big indexing /
Inactive
0
Follow
V
Vi
11 months ago
ยท
Also is there a small to big indexing / retriever
L
V
10 comments
Share
Open in Discord
L
Logan M
11 months ago
https://docs.llamaindex.ai/en/stable/examples/node_postprocessor/MetadataReplacementDemo.html
https://docs.llamaindex.ai/en/stable/examples/retrievers/auto_merging_retriever.html
V
Vi
11 months ago
the one with paragraph as a parent and sentences as the children
V
Vi
11 months ago
instead of an arbitrary window size
V
Vi
11 months ago
is it this one ?
https://docs.llamaindex.ai/en/stable/api/llama_index.node_parser.SentenceSplitter.html
L
Logan M
11 months ago
hmm I don't think we nescarily have something built in to to that. But you could certainly build that with existing tools. That's just a recursive retriever
L
Logan M
11 months ago
I think the hard part with that is you need some step to identify paragraphs in the first place
L
Logan M
11 months ago
(using unstructured?)
L
Logan M
11 months ago
Something like this maybe, but instead of varying chunk sizes, you split into paragraphs and sentences?
https://docs.llamaindex.ai/en/stable/examples/retrievers/recursive_retriever_nodes.html
V
Vi
11 months ago
thank you @Logan M
V
Vi
11 months ago
gonna look into it
Add a reply
Sign up and join the conversation on Discord
Join on Discord