3 ms·

And they literally published the transformer paper back in 2017. I doubt that their next move was to go on vacation for 6 years.