Were you using mlx-lm? I've had good performance with that on Macs. (Sadly, the lead developer just left Apple.) Admittedly, I haven't tried these models on my

Were you using mlx-lm? I've had good performance with that on Macs. (Sadly, the lead developer just left Apple.) Admittedly, I haven't tried these models on my Mac, but I have on my DGX Spark, and they ran fine. I didn't see the slowdown you're mentioning.