Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 7 months ago
0
Follow
when creating nodes, how text is
when creating nodes, how text is
Inactive
0
Follow
A
Azru
7 months ago
Β·
when creating nodes, how text is segmented by default? what is the default chunking strategy
W
1 comment
Share
Open in Discord
W
WhiteFang_Jr
7 months ago
LlamaIndex has default chunking set to 1024 token.
We have default
SentenceSplitter
that you can go through to understand more.
https://docs.llamaindex.ai/en/stable/module_guides/loading/node_parsers/modules/?h=sentencesplitter#sentencesplitter
https://docs.llamaindex.ai/en/stable/api_reference/node_parsers/sentence_splitter/?h=sentencesplitter#llama_index.core.node_parser.SentenceSplitter
Add a reply
Sign up and join the conversation on Discord
Join on Discord