LlamaIndex
Log in

Find answers from the community

s
F
Y
a
P
Updated 2 years ago

Is there a FOSS vectorizer to store

VVoldev
·
Is there a FOSS vectorizer to store things in the vectorDBs? I don't want to use the OpenAI embeddings API, looking for something that can be run entirely local.
L
V
d
6 comments
LLogan M
You can use any embedding model from huggingface, which will run locally:
https://gpt-index.readthedocs.io/en/latest/how_to/customization/embeddings.html#custom-embeddings
VVoldev
Wonderful, thank you!
dderhyperschlaue
Does that mean that it will run completely onPrem? How big is the model?
VVoldev
Embedding models typically aren't that big iirc, I've done a lot of stuff with like, w2v models and those can evaluate real smol
LLogan M
yea it's all on prem (minus downloading the weights)
LLogan M
by default it's using this https://huggingface.co/sentence-transformers/all-mpnet-base-v2
Add a reply
Sign up and join the conversation on Discord