4 ms·
The runtime is quadratic for a given context size, although it seems like there is some progress on this front https://gwern.net/note/attention https://gwern.ne
by nwlieb 3y ago
The runtime is quadratic for a given context size, although it seems like there is some progress on this front https://gwern.net/note/attention https://gwern.net/note/attention