2 ms·
You can run DeepSeek v4 Flash at 4bit in ~150 GB VRAM, and it would absolutely destroy a 1 bit quant of K3.
by nateb2022 3mo ago
You can run DeepSeek v4 Flash at 4bit in ~150 GB VRAM, and it would absolutely destroy a 1 bit quant of K3.
loading thread…