Find answers from the community

Home
Members
reviewsbyryan
r
reviewsbyryan
Offline, last seen 2 months ago
Joined September 25, 2024
I'm getting this error when attempting to load Writer/camel-5b-hf using GPU:

ValueError: The current device_map had weights offloaded to the disk. Please provide an offload_folder for them. Alternatively, make sure you have safetensors installed if the model you are using offers the weights in this format.

----

Where can I set the parameter for offload_folder?
6 comments
L
r