Find answers from the community

Updated 5 months ago

Hey, I have tried to use the OpenAILike

Hey, I have tried to use the OpenAILike for a local embedding model, but I got error and reading the source code it seems it handles only LLM. I struggle to find what are my option for an openaiLike for embeddings, because the source code of OpenAiEmbeddings seems very related to their model names. I know my embedding uses VLLM behind the scene, but it say to use OpenAiLike.

Anyone has an idea please ? 🙏

4 comments

WWhiteFang_Jr

hey, I think you can try with OpenAIEmbedding and pass in your url.

Plain Text

from llama_index.embeddings.openai import OpenAIEmbedding
embed_model = OpenAIEmbedding(api_base='https://Your_url_here',api_key="")

Try with this.

FFlotos

The problem I have is that it expect specific model names

FFlotos

such as all the ada ones, and mine is from mistral

LLogan M

model_name="fake" it will work fine

Add a reply