3 ms·
Are we at a point where we could run nonquantized models from QwQ/Qwen series on a 128GB Macbook Pro?
by therein 2y ago
Are we at a point where we could run nonquantized models from QwQ/Qwen series on a 128GB Macbook Pro?
- simonw 2y agoI think so. Are bf16 models nonquantized? There's an MLX one here that should fit on that machine: https://huggingface.co/mlx-community/QwQ-32B-Preview-bf16 https://huggingface.co/mlx-community/QwQ-32B-Preview-bf16