4 ms·
Have you tried https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit ? PrismML is the only people i am aware o
by sroussey 1mo ago
Have you tried https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit ? PrismML is the only people i am aware of doing 1bit that is decent.