3 ms·

I'm all for it. It enables those really big models with a relatively small number of active parameters.