The community member is experiencing an issue with a large document, where they are encountering a ValueError related to the size of a term being larger than the allowed chunk size. Another community member has responded, requesting sample data to help reproduce the issue.
I'm getting this issue on a huge document, any ideas? split_text_with_overlaps raise ValueError( ValueError: A single term is larger than the allowed chunk size. Term size: 4105 Chunk size: 3811Effective chunk size: 3811