Find answers from the community

Home
Members
ishaand2
i
ishaand2
Offline, last seen 3 months ago
Joined September 25, 2024
i
ishaand2
·

GPU

I am trying to check why my GPU memory utilisation is so high when ingesting documents into the qdrant vector store.
Despite calling .persist() , it appears that the full set of embeddings are being auto-loaded in memory.

Is there a way to unload/offload the vector store (indices) from & to GPU memory?
13 comments
L
L
i