2 ms·The compute needs for MoE models are set by the amount of active parameters, not total.by zozbot234 8mo agoThe compute needs for MoE models are set by the amount of active parameters, not total.