Find answers from the community

Updated 8 months ago

Hi guys, I am wondering whether there is

Hi guys, I am wondering whether there is a way to use replicate for embeddings? The background is that I can use Google Colab for creating the embeddings for my documents using an open source model, but how would I go about to use the open source model for query embedding in a deployment scenario? Having an instance running only to embed user queries does not some viable for a side project. I would appreciate any ideas πŸ™‚ Thanks in advance!
L
N
2 comments
There isn't a replicate embeddings integration, but there are a ton of other options for embeddings. You can also just straight up implement a custom embeddings class that calls your API

https://docs.llamaindex.ai/en/stable/examples/embeddings/custom_embeddings/?h=custom+embeddings
Hey, thanks for the quick answer! I will take a closer look at implementing a costum embedding class!
Add a reply
Sign up and join the conversation on Discord