The community member is storing data in a FAISS vectorstore and noticed that the embeddings are null in the docstore or index_store files. They are wondering if this is normal and if the embeddings should be stored in these files as well.
The comments indicate that this is normal, as the embeddings are only stored in the vector store (FAISS) and not in the index store or docstore. However, one community member suggests that with FAISS, the embeddings should be in the docstore. Another community member says they are not seeing anything in the docstore and will rerun with the DEBUG flag to understand what's happening.
I'm storing my data in a FAISS vectorstore, and when I look at the docstore or index_store files, I see embeddings as null. Is it normal? Shouldnt they be stored in these files too?
Here is the way I generate the data:
for node in nodes:
node_embedding = base_embeddings.get_text_embedding(
node.get_content(metadata_mode="all")
)
node.embedding = node_embedding
vector_store.add(nodes)
index.storage_context.persist()
ah great, thanks for the details. I'm using the metadata extractor as well, I guess this is only stored in the vector store too.... that would be interesting to see the metdata in cleartext though
