3 ms·SonicMoE: A HW-Efficient and SW-Extensible Blueprint for Fine-Grained MoEs2 points by matt_d 6mo ago