It's a safe bet that Google is using transformers at scale for search and translations - the full extent isn't public but they release a fair amount of research

It's a safe bet that Google is using transformers at scale for search and translations - the full extent isn't public but they release a fair amount of research papers, e.g. the current article, or https://ai.googleblog.com/2020/06/recent-advances-in-google-translate.html https://ai.googleblog.com/2020/06/recent-advances-in-google-... Github Copilot is definitely GPT-3-based and is seeing real-world use https://copilot.github.com https://copilot.github.com Transformers are state of the art for many tasks so they are likely to be used for "intelligent" processing of text or speech data, but due to practical limitations you are probably interacting with them mostly through web services.