4 ms·
"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".
by amelius 2mo ago
"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".
- ViscountPenguin 2mo agoA quick look at the continuous diffusion models linked in the post shows lots of transformer models still
- p1esk 2mo agoIt’s the opposite: attention is necessary but not sufficient.
- slashdave 2mo agoJust about anyone building a large diffusion model is relying on transformers