3 ms·
I run Qwen 3.8 27B just fine on my Mac mini M4 24GB. I use Unsloth's Q3 XXS with 128k context. It successfully completes long horizon tasks with OpenCode.
by jckahn 1mo ago
I run Qwen 3.8 27B just fine on my Mac mini M4 24GB. I use Unsloth's Q3 XXS with 128k context. It successfully completes long horizon tasks with OpenCode.
- tristor 1mo agoYes, Q3 = 3bit quant, so that's not comparable to a 4-bit quant.