4 ms·
Gemma4-E4B (4B params) works pretty well as a local wiki, or when you don't have connectivity.
by dist-epoch 2mo ago
Gemma4-E4B (4B params) works pretty well as a local wiki, or when you don't have connectivity.
- dannyw 2mo agoNitpick: Gemma4-E4B is actually a 8 billion param model, but only 4.5B params worth of memory bandwidth needed per decode.