Find answers from the community

Updated 3 months ago

So mind as well use the OpenAI call with

So mind as well use the OpenAI call with a vanilla vllm server then?
L
A
4 comments
VllmServer doesn't start a server, it's meant to connct to a server you already have running
Yeah I kinda already figured it out, we are just using the OpenAILike llm πŸ‘
It wasn't working before because of a typo πŸ˜›
Add a reply
Sign up and join the conversation on Discord