3 ms·35b-a3b is only 3b active parameters, it's a MoE.by smcleod 4mo ago35b-a3b is only 3b active parameters, it's a MoE.