Log in
Log into community
Find answers from the community
s
F
Y
a
P
3,278
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 years ago
0
Follow
Text splitting
Text splitting
0
Follow
R
Ray Li
2 years ago
ยท
awesome! I was wondering if there are Any best practices for choosing the appropriate node length? IMHO a larger window may adds too much noise yet a small window might lose context info/
L
R
5 comments
Share
Open in Discord
L
Logan M
2 years ago
My best advice is to try and group things into logical groups
L
Logan M
2 years ago
Like, if you have clear sections that you can parse out, those make good document splits
L
Logan M
2 years ago
Otherwise, overlapping chunks usually works ok-ish
R
Ray Li
2 years ago
I see. I guess I can use Langchain's text splitter to build nodes and use Llama index, since they offer a few different ones.
L
Logan M
2 years ago
Yea for sure!
Add a reply
Sign up and join the conversation on Discord
Join on Discord