Find answers from the community

Home
Members
Sky Candy 🍬🍭
S
Sky Candy 🍬🍭
Offline, last seen 2 weeks ago
Joined January 3, 2025
My windows system reboot today, and out of nowhere, I am now getting this error.

This code hasnt been changed or updated and had been working with no issues until today.
4 comments
L
S
I am using VLLM to serve up a model. I need to define a keyword to stop. When using OpenAILike, is there a way to define this?

llm=OpenAILike(model=vllm_model, api_base="http://192.168.0.110:8000/v1", api_key="fake",max_tokens=1024)
4 comments
L
S