4 ms·It’s still a dense model so all 27B parameters are active. 35B-A3B activates only 3B at any time.by dofm 3mo agoIt’s still a dense model so all 27B parameters are active. 35B-A3B activates only 3B at any time.