Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
So mind as well use the OpenAI call with
So mind as well use the OpenAI call with
Inactive
0
Follow
A
AlphaAtlas
12 months ago
Β·
So mind as well use the OpenAI call with a vanilla vllm server then?
L
A
4 comments
Share
Open in Discord
L
Logan M
12 months ago
VllmServer
doesn't start a server, it's meant to connct to a server you already have running
A
AlphaAtlas
12 months ago
Yeah I kinda already figured it out, we are just using the OpenAILike llm π
A
AlphaAtlas
12 months ago
It wasn't working before because of a typo π
A
AlphaAtlas
12 months ago
https://github.com/vllm-project/vllm/issues/1707
Add a reply
Sign up and join the conversation on Discord
Join on Discord