Find answers from the community

Updated 2 months ago

Also is there a small to big indexing /

Also is there a small to big indexing / retriever
L
V
10 comments
the one with paragraph as a parent and sentences as the children
instead of an arbitrary window size
hmm I don't think we nescarily have something built in to to that. But you could certainly build that with existing tools. That's just a recursive retriever
I think the hard part with that is you need some step to identify paragraphs in the first place
(using unstructured?)
Something like this maybe, but instead of varying chunk sizes, you split into paragraphs and sentences? https://docs.llamaindex.ai/en/stable/examples/retrievers/recursive_retriever_nodes.html
thank you @Logan M
gonna look into it
Add a reply
Sign up and join the conversation on Discord