4 ms·
That's actually not true: https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM
by abidlabs 3y ago
That's actually not true: https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM
- RC_ITR 3y agoMy understanding of both this and Apple AFT is that they are trained with attention, but then inference is done as an RNN. Is your understanding different?