Find answers from the community

Updated 4 months ago

Does anyone know how to use llama3 as

Does anyone know how to use llama3 as the LLM model in llamaindex without ollama? Can we instead use Huggingface? I don't want to use ollama because I don't know where it does save the model and how to change the saving directory.
R
4 comments
I think you're looking for this
you want : llama_index.llms.HuggingFaceLLM
there are code examples on that page
Add a reply
Sign up and join the conversation on Discord