3 ms·
We also made some dynamic MLX ones if they help - it might be faster for Macs, but llama-server definitely is improving at a fast pace. https://huggingface.co/
by danielhanchen 6mo ago
We also made some dynamic MLX ones if they help - it might be faster for Macs, but llama-server definitely is improving at a fast pace.
https://huggingface.co/unsloth/Qwen3.6-27B-UD-MLX-4bit https://huggingface.co/unsloth/Qwen3.6-27B-UD-MLX-4bit
- DarmokJalad1701 6mo agoWhat exactly does the .sh file install? How does it compare to running the same model in, say, omlx?
- danielhanchen 5mo agoSorry on the delay - so it installs https://github.com/Blaizzy/mlx-vlm https://github.com/Blaizzy/mlx-vlm and other components and sets up the commands - you don't need to use it but we thought it might be easier for folks