3 ms·
It seems like this is a new architecture, alongside Mamba, Hyena, RWKV and Hybrid Transformer.
by startupsfail 2y ago
It seems like this is a new architecture, alongside Mamba, Hyena, RWKV and Hybrid Transformer.
- zwaps 2y agoThe site insinuates that it is a set of flexible and probably parametric mix between full attention and linear conplexity models