Find answers from the community

Updated 5 months ago

can't run on my dev pc forever

At a glance

The community members discuss options for running a model beyond a development PC. They mention that cloud-based solutions like Hugging Face, Modal, and AWS can cost around $1 per hour, but require 24/7 uptime. The cheapest option suggested is using the community member's own laptop or desktop as a server.

can't run on my dev pc forever
L
s
4 comments
Most options (huggingface inference endpoint, modal, aws) run for about $1-ish an hour
The thing with hosting a model is that you basically need 24 hour uptime
using your laptop or desktop as a server is the cheapest option
Add a reply
Sign up and join the conversation on Discord