2 ms·
A very good primer to state-space models (from which Mamba is based on) is The Annotated S4 [1]. If you want to dive into the code I wrote a minimal single-file
by red2awn 2y ago
A very good primer to state-space models (from which Mamba is based on) is The Annotated S4 [1]. If you want to dive into the code I wrote a minimal single-file implementation of Mamba-2 here [2].
[1]: https://srush.github.io/annotated-s4/ https://srush.github.io/annotated-s4/
[2]: https://github.com/tommyip/mamba2-minimal https://github.com/tommyip/mamba2-minimal