3 ms·
There's MLX versions of the model, so yes. LM Studio hasn't updated their mlx-lm runtime yet though, you'll get an exception. But if you're OK running it witho
by axoltl 10mo ago
There's MLX versions of the model, so yes. LM Studio hasn't updated their mlx-lm runtime yet though, you'll get an exception.
But if you're OK running it without a UI wrapper, mlx_lm==0.30.0 will serve you fine.
- anon373839 10mo agoLooks like LM Studio just updated the MLX runtime, so there's compatibility now.
- axoltl 10mo agoYep! 60t/s on the 8 bit MLX on an M4 Pro with 64GB of RAM.