2 ms·
That is not completely true. There are RNNs with transformer/LLM-like performance. See e.g. https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-L
by nextos 3y ago
That is not completely true. There are RNNs with transformer/LLM-like performance. See e.g. https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM.
They are less popular, and less explored. But an interesting route ahead.