Hi I m trying to save and load my index

At a glance

Hi! I'm trying to save and load my index using the GPTVectorStoreIndex class. However, I keep getting an error when I try to reload my index:

Plain Text

gpt_index = GPTVectorStoreIndex(documents, llm_predictor=llm_predictor)
gpt_index.save_to_disk('./indices/gpt_index.json') # Works great! Saved to disk

loaded_index = GPTVectorStoreIndex.load_from_disk('./indices/gpt_index.json')

Error:

Plain Text

 TypeError: __init__() got an unexpected keyword argument 'simple_vector_store_data_dict'

11 comments

KKev 🤖

Seems to me like this would work, considering the only argument I need is a save_path but I could be mistaken!

LLogan M

I think that class isn't intended to be used directly

Try using GPTSimpleVectorIndex instead

(Also heads up, you'll want to pass in llm_predictor again when loading from disk to keep the llm settings)

KKev 🤖

Thanks @Logan M !

KKev 🤖

Getting a bit closer now. Here's the error I get when I do:

Plain Text

loaded_index = GPTSimpleVectorIndex.load_from_disk('./indices/gpt_index.json', llm_predictor=llm_predictor)

Error:

Plain Text

ValueError: doc_type vector_store not found in type_to_struct. Make sure that it was registered in the index registry.

If I look in the json, I can see "__type__": "vector_store"} at the end of an embedding trail, but maybe I should save the initial index in a specific way to ensure it can read the type_to_struct ?

LLogan M

Did you save the index using GPTSimpleVectorIndex as well? (Sorry, should have clarified that too)

KKev 🤖

Nah, I saved it using GPTVectorStoreIndex . Is this deprecated?

LLogan M

It's meant to be a Base class for all the vector indexes to inherit from.

Did you see a tutorial or example using that class?

LLogan M

I would use GPTSimpleVectorIndex, or one of the other vector indexes we have for 3rd party vector stores (pinecone, chroma, qdrant, etc.)

KKev 🤖

I haven't seen this! Where can I find that?

LLogan M

Lots of examples in the repo 💪here's one you might find helpful https://github.com/jerryjliu/llama_index/blob/main/examples/vector_indices/SimpleIndexDemo.ipynb

Also the docs are a great resource, I would start on this page: https://gpt-index.readthedocs.io/en/latest/guides/usage_pattern.html

KKev 🤖

Thanks again for all your help @Logan M ! :keanuthanks:

Add a reply

Find answers from the community

Hi I m trying to save and load my index