4 ms·
I wonder how different their method actually is from other sub-quadratic sparse attention methods like Reformer [1] and Routing Transformer [2]. [1]: https://a
by in-silico 5mo ago
I wonder how different their method actually is from other sub-quadratic sparse attention methods like Reformer [1] and Routing Transformer [2].
[1]: https://arxiv.org/abs/2001.04451 https://arxiv.org/abs/2001.04451
[2]: https://arxiv.org/abs/2003.05997 https://arxiv.org/abs/2003.05997