Find answers from the community

Updated 2 years ago

Saving loading

Is there an example showing the proper way for saving / loading several GPTVectorStoreIndex indices (each txt file should have an associated index)?
In the older version there was a single json per index but now it's more complicated and I'm not sure how to have multiple indices

7 comments

LLogan M

Instead of each index having a json file, each index has a folder with up to 3 files in it

You can just call index.storage_context.persist(persist_dir="my_index") for each index you want to save (with a different name for each of course)

yyoelk

Thanks @Logan M, that's a possible solution that would create a folder per index. I guess if I want to put them all in the same folder I should set a different name for the doc store, index store and vector store

LLogan M

I thiiink so. I think you can also set an index ID (and also specify the ID when you load) and share the docstore and vector store.. at least I thought I saw that somewhere in the docs lol

LLogan M

https://gpt-index.readthedocs.io/en/latest/how_to/storage/save_load.html#loading-data

LLogan M

They seem to load multiple indexes at once there

LLogan M

You can set the index id before saving with index.set_index_id('my index')

yyoelk

Great thanks 🙂

Add a reply