3 ms·100% agree. MoE is the perfect example: reducing FLOPs while keeping intelligenceby brunaxLorax 2mo ago100% agree. MoE is the perfect example: reducing FLOPs while keeping intelligence