4 ms·
For the amount of theoretical work behind those Mamba2 blocks (I can barely understand their paper on the subject), those are some extremely modest performance
by PoignardAzur 2y ago
For the amount of theoretical work behind those Mamba2 blocks (I can barely understand their paper on the subject), those are some extremely modest performance gains.
Attention remains king.
- erichocean 2y agoMamba is also much more efficient, watt-wise, to run.
- visarga 2y ago> I can barely understand their paper on the subject Yannic Kilcher has a new video touching on Mamba in an intuitive way. https://www.youtube.com/watch?v=jE9jAZC42NE https://www.youtube.com/watch?v=jE9jAZC42NE