4 ms·

My nearly new 48GB A6000 is basically an ancient artifact relative to the exploding size of MoE requirements.