4 ms·
I got a 3 bit quantized version of this running on my Mac - using up 48GB RAM of my 64GB total - and it really impressed me. I used MLX (via uv) to run this ver
by simonw 1y ago
I got a 3 bit quantized version of this running on my Mac - using up 48GB RAM of my 64GB total - and it really impressed me. I used MLX (via uv) to run this version: https://huggingface.co/mlx-community/GLM-4.5-Air-3bit https://huggingface.co/mlx-community/GLM-4.5-Air-3bit
Notes on how I got that working, plus a neat Space Invaders clone it built me: https://simonwillison.net/2025/Jul/29/space-invaders/ https://simonwillison.net/2025/Jul/29/space-invaders/