do we have any other text preprocessor apart from textsplitter and recursivetextsplitter? for one document textsplitter works good and sometime on other recuresivetextsplitter works good, sometimes neither of them. cc: , ,
Tbh I wouldn't worry too much about how the text is being split. Since there's a large amount of text overlap when injesting documents (default 200 tokens), the splits end up not mattering as much
