Hello,

TThomas1234

Hello,
I want to my users to be able to share document between another. I’m using qdrant, I’m wondering if the best practice would be to have an index per document, and each user have a collection of index, or if there is a way to move a file from one index (collection) to another collection without having to re do the embedding part ?

14 comments

LLogan M

I think its best practice to use filters -- its what qdrant actually recommends

LLogan M

https://qdrant.tech/documentation/guides/multiple-partitions/

TThomas1234

I see, is it possible to add the group ID using llama index ?

LLogan M

yea -- that would just be a piece of metadata attached to the document/node

LLogan M

Then you can filter on that 👍

LLogan M

group_id is just the example too, it could be anything

LLogan M

username, organzation, etc.

TThomas1234

I’m not sure to fully understand, where would this be used, when loading the query index or when querying it ?

LLogan M

For example

Plain Text

documents = [
  Document(text=..., metadata={"user_id": "123"})
  Document(text=..., metadata={"user_id": "321"})
]

index = VectorStoreIndex.from_documents(documents, ...)

from llama_index.core.vector_stores import (
    MetadataFilter,
    MetadataFilters,
    FilterOperator,
)

filters = MetadataFilters(
    filters=[
        MetadataFilter(key="user_id", operator=FilterOperator.EQ, value="123"),
    ]
)

# filtered query engine
query_engine = index.as_query_engine(..., filters=filters)

# filtered retriever
retriever = index.as_retriever(..., filters=filters)

etc.

LLogan M

Hope that makes sense

TThomas1234

Right I see !
Thanks a lot

TThomas1234

@Logan M do you know if it’s possible to have several filter with an OR ? When I try to set the condition with something like it’s always an AND

filters = MetadataFilters(
filters=[
MetadataFilter(key="user_id", operator=FilterOperator.EQ, value="user_id_1"),
MetadataFilter(key="user_id", operator=FilterOperator.EQ, value="123"),
],
condition=FilterCondition.OR,
)

LLogan M

Looks like the QdrantVectorStore treats everything as AND under the hood

LLogan M

you could pass in the filters in qdrant syntax, instead of using the filter objects

Plain Text

retriever = index.as_retriever(
    vector_store_kwargs={"qdrant_filters": <qdrant syntax filter>}
)

Add a reply

Find answers from the community

Hello,