Find answers from the community

Updated 3 months ago

'ello all 👋 is there a way to speed-up

'ello all 👋 is there a way to speed-up/parallelize SimpleDirectoryReader?

4 comments

Yes!

.load_data(num_workers=4)

great stuff.

learned i needed to make sure i do that only in acall impl (vs. call) when reading/loading data in an async tool

does this work with splitting too?

Add a reply