4 ms·
The RWKV people seem to have adapted a recursive model so it can be trained in a special parallel mode like attention. https://github.com/BlinkDL/RWKV-LM https
by _0ffh 4y ago
The RWKV people seem to have adapted a recursive model so it can be trained in a special parallel mode like attention.
https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM
- shawntan 4y agoYeah I really like this project, and I've been meaning to dive into it.