Find answers from the community

Updated last year

Huggingface

At a glance

hi, I'm new in AI, I want to use hugging face model instead of chatgpt api, to be more specific, I want to use the vilm/vinallama-2.7b-chat-GGUF on hugging face. Do we have any tutorials on this. Thanks

2 comments

WWhiteFang_Jr

Yes, you can follow this tutorial to use huggingface hosted llm with llama-index: https://docs.llamaindex.ai/en/stable/examples/customization/llms/SimpleIndexDemo-Huggingface_stablelm.html

WWhiteFang_Jr

This model uses stablelm, you'll have to make replace the llm, if there is particular prompt, replace that as well.

I guess that should be enough for you to get going!!

Add a reply