The community members are discussing ways to save and load an index, such as storing it in S3 or a database like Postgres. Some community members suggest that most indices can be serialized to a JSON file on disk, while others mention that some indices like Weaviate and Pinecone are backed by their respective databases. The community members also discuss the challenges of working with storage on platforms like Fly.io, and the idea of adding "serializer" classes to save the index to external stores is proposed.
Wondering if there's any way to save/load an index to S3 or some other filestore? I suppose we'd then need to download the whole index every time a query is run?
