4 ms·
Attention is just convolution in a Hopf algebra.
by adamnemecek 3y ago
Attention is just convolution in a Hopf algebra.
- meindnoch 3y agoYou took the words right out of my mouth!
- adamnemecek 3y agoSarcasm?
- meindnoch 3y agoYes.
- adamnemecek 3y agoI wrote a paper on the topic but local heterodoxy police doesn't like it when I link it. So look up my name on arxiv.
- TeMPOraL 3y agoDoes this have explanatory value, or is it the case of "${term} is a ${simple concept} in ${highly specialized framework that's designed specifically so that ${term} is a case of ${simple concept} in it}"?
- frakt0x90 3y agoYeah it's "A monad is just a monoid in the category of endofunctors" rehashed for the millionth time.