3 ms·
oh ok thank you. so something like MoE? That might not be so correct but at least the models need different architecture(MatFormer) to be classified under gemma
by nh43215rgb 1y ago
oh ok thank you. so something like MoE? That might not be so correct but at least the models need different architecture(MatFormer) to be classified under gemma3n.
- canyon289 1y agoIts not an MOE, its what's referred to as a dense architecture, same as the Gemma3 models (But not 3n as noted)