3 ms·
We went over it in our Friday paper club before the holidays which helped me gain an intuition. https://blog.oxen.ai/mamba-linear-time-sequence-modeling-with-s
by gschoeni 3y ago
We went over it in our Friday paper club before the holidays which helped me gain an intuition.
https://blog.oxen.ai/mamba-linear-time-sequence-modeling-with-selective-state-spaces-arxiv-dives/ https://blog.oxen.ai/mamba-linear-time-sequence-modeling-wit...
I'm still not convinced on Mamba's performance on Natural Language tasks, but maybe it's just because they haven't trained a large enough model on enough data yet.