Find answers from the community

Updated 10 months ago

if I use a text splitter after loading

At a glance
if I use a text splitter after loading from the simple directory reader, that splitter splits only within a single document. Is this the case for all file types?
What I am trying to understand is if I want to chunk my pdf using a fixed size, I can't do that over the entire pdf? It can only be over the pages that are returned as documents witht eh simple directory reader?
L
j
3 comments
The default pdf loader splits by page to make finding sources easier
You can combine it back into a single document object if you wanted
Thanks. I figured that must be what I needed to do
Add a reply
Sign up and join the conversation on Discord