Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 6 months ago
0
Follow
when creating nodes, how text is
when creating nodes, how text is
Inactive
0
Follow
A
Azru
6 months ago
ยท
when creating nodes, how text is segmented by default? what is the default chunking strategy
W
1 comment
Share
Open in Discord
W
WhiteFang_Jr
6 months ago
LlamaIndex has default chunking set to 1024 token.
We have default
SentenceSplitter
that you can go through to understand more.
https://docs.llamaindex.ai/en/stable/module_guides/loading/node_parsers/modules/?h=sentencesplitter#sentencesplitter
https://docs.llamaindex.ai/en/stable/api_reference/node_parsers/sentence_splitter/?h=sentencesplitter#llama_index.core.node_parser.SentenceSplitter
Add a reply
Sign up and join the conversation on Discord
Join on Discord