Is there a way to load individual s3

The S3 loader ( https://llamahub.ai/l/s3 ) will index documents directly from S3 without you needing to do any manual downloading, is that what you mean?

Obviously to index the document locally the file does need to get downloaded somehow 😄

Sure, I ended up just downloading the file locally, my goal was to find a way to just pipe it into memory or something but that'll do