Find answers from the community

Updated last year

Hey guys, I have looked around

At a glance
Hey guys, I have looked around documentation and found nothing regarding getting the index at which text was split using TokenTextSplitter for example.

For now it returns the usual metadata, page number and document name, but I would like to have at which index it was split.

I think langchain as an option for this, is there something similar here?
Maybe a callback?
L
s
2 comments
It should be setting node.start_char_idx and node.end_char_idx, at least in recent versions of llama-index
you are god sent, thank you man
Add a reply
Sign up and join the conversation on Discord