LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

I am wondering may I use custom LLM

ttianzhi4599
·
I am wondering may I use custom LLM/embedding API (deployed by myself) for underlying LLM/embedding in llamaindex?
L
t
2 comments
LLogan M
Of course

LLM
https://gpt-index.readthedocs.io/en/latest/core_modules/model_modules/llms/usage_custom.html#example-using-a-custom-llm-model-advanced

Embeddings
https://gpt-index.readthedocs.io/en/latest/core_modules/model_modules/embeddings/usage_pattern.html#custom-embedding-model
ttianzhi4599
Thanks a lot.
Add a reply
Sign up and join the conversation on Discord