LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Local LLM

cchanansh
·
I have now
Plain Text
openai.error.RateLimitError: You exceeded your current quota, please check your plan and billing details.

How can I use a local downloaded model from hugging face, for example, rather then using openAI API?
L
1 comment
LLogan M
You'll need to setup both an embedding model and LLM to fully replace openai

https://gpt-index.readthedocs.io/en/stable/how_to/customization/custom_llms.html#example-using-a-custom-llm-model

https://gpt-index.readthedocs.io/en/stable/how_to/customization/embeddings.html#custom-embeddings
Add a reply
Sign up and join the conversation on Discord