4 ms·It's 5B active params in MoE, not 5B total params (total is 137B).by necubi 5mo agoIt's 5B active params in MoE, not 5B total params (total is 137B).