3 ms·

and back then in 2017, AI hasn't really been productized yet, people behind Transformer were researchers, publishing their results were the norm.