that's a great arxiv translation, a model for ML elucidation re: Transformers, see also: https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c74ce0 http

that's a great arxiv translation, a model for ML elucidation re: Transformers, see also: https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c74ce0 https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c7... which suggests that Transformers have been supplanted by simple conv2d networks that span both the input and the out; also mentioned are "hierarchical neural attention encoders", but no links; q.v. https://www.cs.cmu.edu/~hovy/papers/16HLT-hierarchical-attention-networks.pdf https://www.cs.cmu.edu/~hovy/papers/16HLT-hierarchical-atten...