Find answers from the community

Updated 2 months ago

I want to build a RAG using LlamaIndex

I want to build a RAG using LlamaIndex and Llama3.1 but I don't want to install and download the model every time from ollama. Is there a way to download Llama3.1 and then load it to be used with the LlamaIndex framework?
R
1 comment
Ollama downloads model weights only the first time and loads them later on. the models are stored in ~/.ollama/models. You can modify the path by updating OLLAMA_MODELS env variable: OLLAMA_MODELS='<path>'. Then the first time, it'll be downloaded there and the weights will be reused in the future.
Add a reply
Sign up and join the conversation on Discord