3 ms·
Qwen 3 now supports ARM and MLX
- anemll 1y agoIt’s also supported in Apple Neural Engine https://github.com/Anemll/Anemll https://github.com/Anemll/Anemll
- ukuina 1y ago[June 2025]
- NiekvdMaas 1y agoOld post indeed: https://x.com/Alibaba_Qwen/status/1934517774635991412 https://x.com/Alibaba_Qwen/status/1934517774635991412
- littlestymaar 1y agoThe unfortunate thing with their Qwen3-next naming is that it doesn't reflect on the fact that the architecture is completely different from Qwen3. Much more different than the difference between Qwen2 and Qwen3 even. So support is likely to take quite some time because it's not just regular transformer blocks stacked on each other, but a brand new hybrid architecture using SSM.
- NiekvdMaas 1y agoFrom https://github.com/ggml-org/llama.cpp/issues/15940#issuecomment-3286596522 https://github.com/ggml-org/llama.cpp/issues/15940#issuecomm...: > This is a massive task, likely 2-3 months of full-time work for a highly specialized engineer. Until the Qwen team contributes the implementation, there are no quick fixes.
- veber-alex 1y agoIt's already supported in vLLM, SGLang and MLX.
- littlestymaar 1y agoThe Qwen team made sure to land PRs to vLLM and SGLang on the first day, which is nice.
- p0w3n3d 1y agoYeah I've been using qwen3 on mlx in July already