Seems like the article is mistaken on one part. Attention was first coined in this paper (as far as I know): https://arxiv.org/pdf/1409.0473v7.pdf https://arx

Seems like the article is mistaken on one part. Attention was first coined in this paper (as far as I know): https://arxiv.org/pdf/1409.0473v7.pdf https://arxiv.org/pdf/1409.0473v7.pdf The second page of the introduction of the "Hierarchical Attention Networks for Document Classification" paper mentioned in the article even cites it.