Find answers from the community

Updated 2 years ago

I m getting this issue on a huge

At a glance

I'm getting this issue on a huge document, any ideas?
split_text_with_overlaps
raise ValueError(
ValueError: A single term is larger than the allowed chunk size.
Term size: 4105
Chunk size: 3811Effective chunk size: 3811

1 comment

jjerryjliu0

hi @cgfdev , thanks for flagging. do you have some sample data to help me repro on?

Add a reply