3 ms·
It probably means that AI is getting more use outside technical circles. I would definitely include Mamba state space models and of course would prefer a techn
by xiphias2 3y ago
It probably means that AI is getting more use outside technical circles.
I would definitely include Mamba state space models and of course would prefer a technical review over a corporate review of the year.
- YetAnotherNick 3y agoFor all we know, Mamba could be overhyped and could only work for small models. Remember retnet[1] which said the same thing, equal to transformer in linear time. [1]: Retentive Network: A Successor to Transformer for Large Language Models: https://arxiv.org/abs/2307.08621 https://arxiv.org/abs/2307.08621