Find answers from the community

Updated 6 months ago

Hey, I have tried to use the OpenAILike

Hey, I have tried to use the OpenAILike for a local embedding model, but I got error and reading the source code it seems it handles only LLM. I struggle to find what are my option for an openaiLike for embeddings, because the source code of OpenAiEmbeddings seems very related to their model names. I know my embedding uses VLLM behind the scene, but it say to use OpenAiLike.

Anyone has an idea please ? πŸ™
W
F
L
4 comments
hey, I think you can try with OpenAIEmbedding and pass in your url.

Plain Text
from llama_index.embeddings.openai import OpenAIEmbedding
embed_model = OpenAIEmbedding(api_base='https://Your_url_here',api_key="")


Try with this.
The problem I have is that it expect specific model names
such as all the ada ones, and mine is from mistral
model_name="fake" it will work fine
Add a reply
Sign up and join the conversation on Discord