3 ms·

I believe you are correct, at least for GPT-3 scaled things. Hopefully that'll change with time, though.