Log in
Log into community
Find answers from the community
s
F
Y
a
P
3,278
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 years ago
0
Follow
Is there a FOSS vectorizer to store
Is there a FOSS vectorizer to store
0
Follow
V
Voldev
2 years ago
ยท
Is there a FOSS vectorizer to store things in the vectorDBs? I don't want to use the OpenAI embeddings API, looking for something that can be run entirely local.
L
V
d
6 comments
Share
Open in Discord
L
Logan M
2 years ago
You can use any embedding model from huggingface, which will run locally:
https://gpt-index.readthedocs.io/en/latest/how_to/customization/embeddings.html#custom-embeddings
V
Voldev
2 years ago
Wonderful, thank you!
d
derhyperschlaue
2 years ago
Does that mean that it will run completely onPrem? How big is the model?
V
Voldev
2 years ago
Embedding models typically aren't that big iirc, I've done a lot of stuff with like, w2v models and those can evaluate real smol
L
Logan M
2 years ago
yea it's all on prem (minus downloading the weights)
L
Logan M
2 years ago
by default it's using this
https://huggingface.co/sentence-transformers/all-mpnet-base-v2
Add a reply
Sign up and join the conversation on Discord
Join on Discord