4 ms·
And this uses Hyena, that can be considered a "previous generation" of Mamba. I think that this anwsers the question about the scalability of SSM and the transf
by bratao 3y ago
And this uses Hyena, that can be considered a "previous generation" of Mamba. I think that this anwsers the question about the scalability of SSM and the transformer finally found an opponent.
- deleted 3y ago[deleted]
- algo_trader 3y ago> H 7B is always faster than optimized Transformers > (>10%, >20% and >50% end-to-end faster than FlashAttention 50% improvement on very large sequences is great. But it is not yet transformative (pun intended..) Presumably FlashAttention already does lots of the less-than-quadratic improvement
- ttul 3y agoWell, since Together did hire the author of Mamba…