3 ms·
How does that one compare to RWKV?
by ilaksh 4y ago
How does that one compare to RWKV?
- smaddox 4y agoRWKV is random chance on the PathX problem. Both of those models are > 95% on it, if I remember correctly. I don't think Hyena can be run in RNN mode, though. But it _might_ scale better than the LRU model (second paper).