3 ms·
Sounds interesting, but... > these models dominate both exponential attention and linear attention at long-context training There is no exponential attention;
by cubefox 9mo ago
Sounds interesting, but...
> these models dominate both exponential attention and linear attention at long-context training
There is no exponential attention; standard attention is quadratic. Strange mistake.