Hi, I have multiple documents that uploaded by a user, then I persist them in a S3 storage. As I know it would be OK to persist indices in the same persist_dir with the same storage context. But I can't have the same storage context because users don't upload documents as the same time => indices will be override when new document arrives. I'm thinking about create a folder for each document, like {s3_bucket}/{doc_id}, maybe it will work. Although, in loading state, I have to use a loop to load all documents' index.
Is it the correct way to handle such situation? Do you guys have any suggestion for improvement? Thanks in advance.
