Find answers from the community

Updated 11 months ago

Hey guys, I have looked around

Hey guys, I have looked around documentation and found nothing regarding getting the index at which text was split using TokenTextSplitter for example.

For now it returns the usual metadata, page number and document name, but I would like to have at which index it was split.

I think langchain as an option for this, is there something similar here?
Maybe a callback?
L
s
2 comments
It should be setting node.start_char_idx and node.end_char_idx, at least in recent versions of llama-index
you are god sent, thank you man
Add a reply
Sign up and join the conversation on Discord