For those wondering how on earth they are getting decent results from a RNN without long range forgetting, I don't really know either! But they reference https

For those wondering how on earth they are getting decent results from a RNN without long range forgetting, I don't really know either! But they reference https://arxiv.org/abs/2105.14103 https://arxiv.org/abs/2105.14103 and the bottom section of https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM has an explainer.