I need to run Open Source LLMs on my mac m1 pro.
But I keep getting No GPU found. A GPU is needed for quantization.

Did anyone had any luck with running LLMs on macos m1?

Is it possible to utilize docker for that?