3 ms·What a wrong take. Its not even MoE that was great in deepseek, its shared expert + grpoby davidguetta 1y agoWhat a wrong take. Its not even MoE that was great in deepseek, its shared expert + grpo