4 ms·
lol. Interesting stuff but here I was thinking this was about the new transformer architecture. Differential Transformer https://arxiv.org/abs/2410.05258 https
by K0balt 2y ago
lol. Interesting stuff but here I was thinking this was about the new transformer architecture.
Differential Transformer https://arxiv.org/abs/2410.05258 https://arxiv.org/abs/2410.05258
- topspin 2y agoLikewise. I was pleased to find this instead.
- Onavo 2y agoThis is your grand papa's transformer :D
- userbinator 2y agoWhy do you think I submitted this ;-)
- K0balt 2y agoI suspected as much lol. Still, interesting stuff.