Find answers from the community

Updated 3 months ago

Hi am wondering if anyone can help me I

Hi, am wondering if anyone can help me. I want to use HierarchicalNodeParser, but want to customise the chunk sizes/heirarchy. I'd like to try two levels of hierarchy, with the top level with a large chunk size and the lower level with a much smaller chunk size. I can't work out how to define this as the examples seem to just use the defaults which don't work for my use case.
b
d
6 comments
the default is chunk_sizes = [2048, 512, 128]
Let me know if that's helpful
Brilliant, I upped the chunk size of the largest part of the hierarchy and it made a major difference to accuracy as I'd hoped! Does it need to be three levels? I don't really get why the middle level is needed.
Next question - how can i create a custom prompt with an AutoMergingRetriever ?
Add a reply
Sign up and join the conversation on Discord