>Attention Is All You Need paper detailing transformers, and it would be an entirely different market if Google had held that as a trade secret. I would guess

>Attention Is All You Need paper detailing transformers, and it would be an entirely different market if Google had held that as a trade secret. I would guess that in that timeline, Google would never have been able to learn about the incredible capabilities of transformer models outside of translation, at least not until much later.