3 ms·
https://arxiv.org/abs/2006.16236 https://arxiv.org/abs/2006.16236 Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
by SomewhatLikely 2y ago
https://arxiv.org/abs/2006.16236 https://arxiv.org/abs/2006.16236 Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention