4 ms·Mixture of Experts (Moe): How Transformers Scale Without Activating Everything1 points by ibobev 2mo ago