3 ms·
Yeah, I'm seeing 8-9 t/s on a Xeon CPU E3-1270 V2 @ 3.50GHz with an old Nvidia Quadro K2200 (4GB). I run gemma4:e2b and gemma4:12b-it-qat on Ollama.
by kQq9oHeAz6wLLS 3mo ago
Yeah, I'm seeing 8-9 t/s on a Xeon CPU E3-1270 V2 @ 3.50GHz with an old Nvidia Quadro K2200 (4GB). I run gemma4:e2b and gemma4:12b-it-qat on Ollama.