3 ms·In the paper they already show a mixing of these two with Mixture-of-Depths-and-Experts (MoDE).by GaggiX 3y agoIn the paper they already show a mixing of these two with Mixture-of-Depths-and-Experts (MoDE).