Find answers from the community

Updated 6 months ago

Local LLM

At a glance

The community member has encountered a rate limit error when using the OpenAI API and is looking for an alternative solution. A comment suggests that to fully replace OpenAI, the community member will need to set up both an embedding model and a large language model (LLM) from Hugging Face. The comment provides links to documentation on how to use custom LLMs and embeddings.

Useful resources
I have now
Plain Text
openai.error.RateLimitError: You exceeded your current quota, please check your plan and billing details.

How can I use a local downloaded model from hugging face, for example, rather then using openAI API?
Add a reply
Sign up and join the conversation on Discord