2 ms·
Gemma 4 12B? This sounds really interesting with Q_4 (preferably QAT) this fits comfortably in 12 or 16 GB VRAM. Could you elaborate on Gemma 4 12B capabilitie
by kpatucha 1mo ago
Gemma 4 12B? This sounds really interesting with Q_4 (preferably QAT) this fits comfortably in 12 or 16 GB VRAM.
Could you elaborate on Gemma 4 12B capabilities from your experience and benchmarks?