3 ms·
Gemma 3 4B QAT int4 quantized from bartowsky should barely fit in a 4GB Raspberry Pi, but without the vision encoder. However the brand-new Gemma 3n E2B and E4
by nolist_policy 1y ago
Gemma 3 4B QAT int4 quantized from bartowsky should barely fit in a 4GB Raspberry Pi, but without the vision encoder.
However the brand-new Gemma 3n E2B and E4B models might fit with vision.
- antirez 1y agoYep, the Gemma 3 1B would be 815MB, with enough margin for a longer prompt. Probably more realistic.