Find answers from the community

Updated 8 months ago

I was able to find in the docs a few

I was able to find in the docs a few months ago but i can't find it anymore.
How can I use text_splitter = SentenceSplitter() and split sentences by Asian Chinese/Japanese characters?
L
c
5 comments
secondary_chunking_regex="[^,.;。?!]+[,.;。?!]?"
Probably modifying that?
Thats the default
oh the default already includes the Japanese characters like
Add a reply
Sign up and join the conversation on Discord