Find answers from the community

Home
Members
derrick
d
derrick
Offline, last seen 3 months ago
Joined September 25, 2024
d
derrick
·

Delete

Hey hey! Is it possible to delete vectors from a vector storage (pgvector) without having a specific document ID? Basically, if my customer has a "dataset" and that dataset was an import of a directory with 4,000 files. The customer then wants to delete the dataset, we want to remove all the vectors associated with those 4,000 files. Is there a way to select all documents with some given metadata and "delete" them?

Or, do I have to use SQLAlchemy/SQL calls to select and remove them?
3 comments
d
L
yeah, looks as if the way we're doing this (using PGVector) doesn't have any real documentation or API exposed for creating filters, or even querying additional columns within the schema (we're using QueryEngineTool and ToolMetadata) so that quite different.
3 comments
d
L
first time trying to work with Milvus as a vectorDB and LlamaIndex, getting this odd exception when running query_engine.query
Plain Text
pymilvus.exceptions.MilvusException: <MilvusException: (code=0, message=metric_type not found in search_params)>

I'm not entirely sure if the defaults are not set for Milvus so I set the search_params with instantiating the MilvusVectorStore but I don't think it's using it or something. Anyone ever run into this?
8 comments
d
L