Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
😞
😐
😃
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
whats the best local model inferencing
whats the best local model inferencing
Inactive
0
Follow
a
aristokratic.eth
last year
·
whats the best local model inferencing API server to use with LlamaIndex? vLLM? Ollama? LM Studio?
L
a
4 comments
Share
Open in Discord
L
Logan M
last year
I think ollama is probably the best supported at the moment
L
Logan M
last year
vLLM is a close second
L
Logan M
last year
(but I think vLLM has a few bugs, been meaning to clean it up)
a
aristokratic.eth
last year
Thank you @Logan M ! Always appreciated
Add a reply
Sign up and join the conversation on Discord
Join on Discord
