Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Embedding
Embedding
Inactive
0
Follow
M
M00nshine
last year
ยท
Anyone running a local embedding api server? I'm looking for some pointers or tips...
W
M
6 comments
Share
Open in Discord
W
WhiteFang_Jr
last year
I think this can help you
https://docs.llamaindex.ai/en/stable/examples/embeddings/text_embedding_inference.html
NOTE
: Before using the llamaindex part, you'll have to deploy the embedding server first
M
M00nshine
last year
So this is a local embedding api server setup?
W
WhiteFang_Jr
last year
It's not the setup, actually you'll have to follow the first mentioned link to setup your api server
W
WhiteFang_Jr
last year
Then you can use llamaindex abstraction on text inference embedding server to use it
W
WhiteFang_Jr
last year
This one:
https://github.com/huggingface/text-embeddings-inference
M
M00nshine
last year
I think this:
https://github.com/huggingface/text-embeddings-inference
.. is what I was looking for thank you. I was looking for a local embedding server solution to get away from huggingface. Lol thank you
Add a reply
Sign up and join the conversation on Discord
Join on Discord