Find answers from the community

Updated 2 months ago

Embedding

Anyone running a local embedding api server? I'm looking for some pointers or tips...
W
M
6 comments
I think this can help you
https://docs.llamaindex.ai/en/stable/examples/embeddings/text_embedding_inference.html


NOTE : Before using the llamaindex part, you'll have to deploy the embedding server first
So this is a local embedding api server setup?
It's not the setup, actually you'll have to follow the first mentioned link to setup your api server
Then you can use llamaindex abstraction on text inference embedding server to use it
I think this: https://github.com/huggingface/text-embeddings-inference .. is what I was looking for thank you. I was looking for a local embedding server solution to get away from huggingface. Lol thank you
Add a reply
Sign up and join the conversation on Discord