Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
whats the best local model inferencing
whats the best local model inferencing
Inactive
0
Follow
a
aristokratic.eth
11 months ago
ยท
whats the best local model inferencing API server to use with LlamaIndex? vLLM? Ollama? LM Studio?
L
a
4 comments
Share
Open in Discord
L
Logan M
11 months ago
I think ollama is probably the best supported at the moment
L
Logan M
11 months ago
vLLM is a close second
L
Logan M
11 months ago
(but I think vLLM has a few bugs, been meaning to clean it up)
a
aristokratic.eth
11 months ago
Thank you @Logan M ! Always appreciated
Add a reply
Sign up and join the conversation on Discord
Join on Discord