3 ms·
Attention Is All You Need
- jruohonen 1y agoBut it was not only attention. And if you now look at the paper viz "standards", well. Maybe it tells something.
- Bluestein 1y agoGood point. Hindsight is warranted. Heavens knows about what (what approach, what tech, what algo) we might be saying the same, a year from now: MoEs, agents, persistent memory ... quantum computing, embodied AI, robotics ...