2 ms·

I wouldn't rule out the fact that transformers are very amenable to parallel computation as the reason