3 ms·SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention2 points by georgehill 3y ago