2 ms·Half the size is not a great metric when comparing a dense model against a MoE.by Havoc 2y agoHalf the size is not a great metric when comparing a dense model against a MoE.