4 ms·

Bibliography of the various approaches to long-context Transformers: https://www.reddit.com/r/MachineLearning/comments/hxvts0/d_breaking_the_quadratic_attention

by gwern 6y ago

Bibliography of the various approaches to long-context Transformers: https://www.reddit.com/r/MachineLearning/comments/hxvts0/d_breaking_the_quadratic_attention_bottleneck_in/ https://www.reddit.com/r/MachineLearning/comments/hxvts0/d_b...