Twitter thread from Albert Gu, a primary author: https://nitter.net/_albertgu/status/1731727672286294400?s=20 https://nitter.net/_albertgu/status/17317276722862

Twitter thread from Albert Gu, a primary author: https://nitter.net/_albertgu/status/1731727672286294400?s=20 https://nitter.net/_albertgu/status/1731727672286294400?s=20 "Quadratic attention has been indispensable for information-dense modalities such as language... until now. Announcing Mamba: a new SSM arch. that has linear-time scaling, ultra long context, and most importantly--outperforms Transformers everywhere we've tried."