Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 10 months ago
0
Follow
I guess I found a way, I check if doc.
I guess I found a way, I check if doc.
Inactive
0
Follow
o
osiworx
10 months ago
Β·
I guess I found a way, I check if doc.text is != '' and then add it to a seperate docs array when I then path to the embedding process. so far it did get around the error
W
o
4 comments
Share
Open in Discord
W
WhiteFang_Jr
10 months ago
Yeah that will work, But curiousAre you making document object by yourself?
If so then you can put a check before making Document object that if the text is empty dont make a document object and pass!
o
osiworx
10 months ago
I do like: documents = SimpleDirectoryReader(folder).load_data()
W
WhiteFang_Jr
10 months ago
It could be that some of your pages are empty thats why it is making document object for that.
In that case your way will work.
o
osiworx
10 months ago
ok cool, its like unknown files with unknown content so I need to get around manually check for 0k files π
Add a reply
Sign up and join the conversation on Discord
Join on Discord