Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 9 months ago
0
Follow
Hi, I want to run an OSS model locally (
Hi, I want to run an OSS model locally (
Inactive
0
Follow
s
snmishra
9 months ago
Β·
Hi, I want to run an OSS model locally (like mixtral), upload a pdf, and ask it questions. Is there a way to do this using Llama index?
T
1 comment
Share
Open in Discord
T
Teemu
9 months ago
Yup, it's possible!
https://www.llamaindex.ai/blog/running-mixtral-8x7-locally-with-llamaindex-e6cebeabe0ab
Add a reply
Sign up and join the conversation on Discord
Join on Discord