11 ms·
Calculating self-attention is still quadratic though. So you get the negatives of transformers there too.
by SpaceManNabs 3y ago
Calculating self-attention is still quadratic though. So you get the negatives of transformers there too.
loading thread…