4 ms·

I wonder if the reasoning capability of a moe model is limited by the max size of the individual experts?