4 ms·

Deepmind did not invent transformers... https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1810.04805 https://arxiv.org/ab

Deepmind did not invent transformers... https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1810.04805 https://arxiv.org/abs/1810.04805

josephg 2y ago
Look at the author lists in the pdfs. Almost all of them are @google.com. They were Google employees when they wrote and published those papers.
- alecco 2y ago
  Google Brain and Google Research are not DeepMind (an acquired company based in London). Transformers came out on 2017. Last year DeepMind was told to merge with the rest of Google AI (kinda). But it looks like they are still quite independent. https://en.wikipedia.org/wiki/Google_Brain https://en.wikipedia.org/wiki/Google_Brain https://en.wikipedia.org/wiki/Google_DeepMind https://en.wikipedia.org/wiki/Google_DeepMind https://research.google/teams/ https://research.google/teams/