Find answers from the community

Updated 6 months ago

I finetuned Mistral model and I have the

At a glance

The community member has finetuned the Mistral model and has the LORA weights, but they are unsure how to load them into Llamaindex. A comment suggests that the community member can load the weights into Hugging Face or quantize them and use them with Ollama.

I finetuned Mistral model and I have the lora weights, i just wanted to know how do i load the same in Llamaindex ? can anyone please help ?
L
1 comment
you can load it in huggingface, or quantize it and throw it into ollama
Add a reply
Sign up and join the conversation on Discord