Find answers from the community

Updated 3 months ago

πŸ‘‹ 'ello all

πŸ‘‹ 'ello all

how to i provide a vector store to an IngestionPipeline run that's from a StorageContext? the vector_store param on IP takes a BasePydanticVector store a storage_context.vector_store is my SimpleVectorStore. it's throwing a dict invalid error

Plain Text
IngestionPipeline(
    transformations=[...],
    docstore=storage_context.docstore, # loads/uses sc docstore
    # errors: vector_store=storage_context.vector_store
).run(documents=documents)
L
e
6 comments
Its really only intended to work with vector stores that store text πŸ€”
as opposed to a store that includes vectors?
By "stores_text", I mean that it stores the node content

FAISS and SimpleVectorStore for example are only storing the vectors alone
Qdrant, Chroma, Weavaite, etc. store the entire node content
ah and are those compact with the IP vector_store?
ill switch, just doing local persistence
Add a reply
Sign up and join the conversation on Discord