Find answers from the community

Updated 8 months ago

i have seen ollama around, but im not

i have seen ollama around, but im not sure if thats an option, will check that out tho
L
1 comment
ollama is nice (it handles all the formatting) but it won't be as fast as vllm
Add a reply
Sign up and join the conversation on Discord