3 ms·
There was a recent thread on explaining Mamba https://news.ycombinator.com/item?id=39501982 https://news.ycombinator.com/item?id=39501982 (https://www.kolaayonr
by smusamashah 3y ago
There was a recent thread on explaining Mamba https://news.ycombinator.com/item?id=39501982 https://news.ycombinator.com/item?id=39501982 (https://www.kolaayonrinde.com/blog/2024/02/11/mamba.html https://www.kolaayonrinde.com/blog/2024/02/11/mamba.html)
There was another one on the same thing, probably better https://news.ycombinator.com/item?id=39482428 https://news.ycombinator.com/item?id=39482428 (https://jackcook.com/2024/02/23/mamba.html https://jackcook.com/2024/02/23/mamba.html)
- dang 3y agoThanks! Macroexpanded: Mamba Explained: The State Space Model Taking On Transformers - https://news.ycombinator.com/item?id=39501982 https://news.ycombinator.com/item?id=39501982 - Feb 2024 (93 comments) Mamba: The Easy Way - https://news.ycombinator.com/item?id=39482428 https://news.ycombinator.com/item?id=39482428 - Feb 2024 (60 comments) Is Mamba Capable of In-Context Learning? - https://news.ycombinator.com/item?id=39286410 https://news.ycombinator.com/item?id=39286410 - Feb 2024 (1 comment) Vision Mamba: Efficient Visual Representation Learning with Bidirectional SSM - https://news.ycombinator.com/item?id=39214939 https://news.ycombinator.com/item?id=39214939 - Feb 2024 (16 comments) MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts - https://news.ycombinator.com/item?id=38932350 https://news.ycombinator.com/item?id=38932350 - Jan 2024 (39 comments) Implementation of Mamba in one file of PyTorch - https://news.ycombinator.com/item?id=38708730 https://news.ycombinator.com/item?id=38708730 - Dec 2023 (109 comments) Show HN: Fortran inference code for the Mamba state space language model - https://news.ycombinator.com/item?id=38687342 https://news.ycombinator.com/item?id=38687342 - Dec 2023 (1 comment) Guide to the Mamba architecture that claims to be a replacement for Transformers - https://news.ycombinator.com/item?id=38659238 https://news.ycombinator.com/item?id=38659238 - Dec 2023 (2 comments) Mamba outperforms transformers "everywhere we tried" - https://news.ycombinator.com/item?id=38606590 https://news.ycombinator.com/item?id=38606590 - Dec 2023 (25 comments) Mamba: Linear-Time Sequence Modeling with Selective State Spaces - https://news.ycombinator.com/item?id=38522428 https://news.ycombinator.com/item?id=38522428 - Dec 2023 (37 comments) Mamba: New SSM arch with linear-time scaling that outperforms Transformers - https://news.ycombinator.com/item?id=38520992 https://news.ycombinator.com/item?id=38520992 - Dec 2023 (2 comments)
- garyiskidding 3y agothank you, these are very helpful.