3 ms·
Transfomers are currently state of art i.e. the problems that transformers are currently solving cant be solved better by any other known technique/algorithm. T
by unlikelymordant 4y ago
Transfomers are currently state of art i.e. the problems that transformers are currently solving cant be solved better by any other known technique/algorithm. Thats the main reason why they are so popular at the moment. LLMs are popular right now because a recent transformer based neural network has proven to be fun/useful i.e. gpt-3/chatgpt. A lot more useful than previous language models at least.
- macrolime 4y agoRWKV is showing that maybe RNNs can perform on par with transformers https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM