LlamaIndex
Log in

Find answers from the community

Updated 9 months ago

Hi, I want to run an OSS model locally (

ssnmishra
·
Hi, I want to run an OSS model locally (like mixtral), upload a pdf, and ask it questions. Is there a way to do this using Llama index?
T
1 comment
TTeemu
Yup, it's possible! https://www.llamaindex.ai/blog/running-mixtral-8x7-locally-with-llamaindex-e6cebeabe0ab
Add a reply
Sign up and join the conversation on Discord