4 ms·On this bench it underperforms vs glm-4.5-air, which is an MoE with fewer total params but more active params.by jph00 1y agoOn this bench it underperforms vs glm-4.5-air, which is an MoE with fewer total params but more active params.