8 ms·

Any recommended product primers to Mamba vs Transformers - pros/cons etc?

• ertgbnm 2y ago
  https://www.youtube.com/watch?v=X5F2X4tF9iM https://www.youtube.com/watch?v=X5F2X4tF9iM This is what introduced me to them. May be a bit outdated at this point.
• bhouston 2y ago
  This video is good: https://www.youtube.com/watch?v=N6Piou4oYx8 https://www.youtube.com/watch?v=N6Piou4oYx8. As are the other videos on the same YouTube account.
• red2awn 2y ago
  A very good primer to state-space models (from which Mamba is based on) is The Annotated S4 [1]. If you want to dive into the code I wrote a minimal single-file implementation of Mamba-2 here [2]. [1]: https://srush.github.io/annotated-s4/ https://srush.github.io/annotated-s4/ [2]: https://github.com/tommyip/mamba2-minimal https://github.com/tommyip/mamba2-minimal
• flakiness 2y ago
  For those who are text oriented: https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mamba-and-state https://newsletter.maartengrootendorst.com/p/a-visual-guide-... The paper author has a blog series but I don't think it's for general public https://tridao.me/blog/2024/mamba2-part1-model/ https://tridao.me/blog/2024/mamba2-part1-model/