I'm following along with the Custom LLM guide here:
https://gpt-index.readthedocs.io/en/latest/examples/customization/llms/SimpleIndexDemo-Huggingface_stablelm.html I've replicated the code locally, but I keep getting the error:
"ValueError: The current
device_map
had weights offloaded to the disk. Please provide an
offload_folder
for them. Alternatively, make sure you have
safetensors
installed if the model you are using offers the weights in this format."
I'm having trouble troubleshooting this in this context, any advice?