Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
😞
😐
😃
Powered by
Hall
Inactive
Updated 8 months ago
0
Follow
I was able to find in the docs a few
I was able to find in the docs a few
Inactive
0
Follow
c
chantlong
8 months ago
·
I was able to find in the docs a few months ago but i can't find it anymore.
How can I use
text_splitter = SentenceSplitter()
and split sentences by Asian Chinese/Japanese characters?
L
c
5 comments
Share
Open in Discord
L
Logan M
8 months ago
secondary_chunking_regex="[^,.;。?!]+[,.;。?!]?"
L
Logan M
8 months ago
Probably modifying that?
L
Logan M
8 months ago
Thats the default
c
chantlong
8 months ago
oh the default already includes the Japanese characters like
。
c
chantlong
8 months ago
thanks
Add a reply
Sign up and join the conversation on Discord
Join on Discord