Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Models
Models
Inactive
0
Follow
A
Augustinas
last year
ยท
Are there any examples of how to use LlamaIndex with other models besides OpenAI?
L
1 comment
Share
Open in Discord
L
Logan M
last year
You can use any model really. Just remember there's two models, an LLM and an embedding model
A) any LLM from langchain, assuming you wrap it with our LLMPredictor class
B) any model from huggingface has native support
https://gpt-index.readthedocs.io/en/latest/how_to/customization/custom_llms.html#example-using-a-huggingface-llm
C) any model from anywhere is also supported, but you have to implement a base class
https://gpt-index.readthedocs.io/en/latest/how_to/customization/custom_llms.html#example-using-a-custom-llm-model-advanced
D) local embeddings from huggingface are also supported (the default model is mpnet-v2)
https://gpt-index.readthedocs.io/en/latest/how_to/customization/embeddings.html#custom-embeddings
Add a reply
Sign up and join the conversation on Discord
Join on Discord