3 ms·
Can you link some of those papers?
by dartos 3y ago
Can you link some of those papers?
- sischoel 3y agoI am not sure if this was the very first paper talking about attention, but https://arxiv.org/abs/1409.0473 https://arxiv.org/abs/1409.0473 from 2014 is a famous one. What is still missing there, is the idea of self-attention.