3 ms·
The key element is that we use neural nets to compute the attention weights, so attention itself is learnable.
by visarga 9y ago
The key element is that we use neural nets to compute the attention weights, so attention itself is learnable.
3 ms·