3 ms·There's also lowering the number of experts you run in MoE models.by lwarfield 3mo agoThere's also lowering the number of experts you run in MoE models.