3 ms·
I strongly agree with Steve on the potential of Nobel prize for the discovery and I want to add that the team probably going to win it within 10 years. For refe
by teleforce 3y ago
I strongly agree with Steve on the potential of Nobel prize for the discovery and I want to add that the team probably going to win it within 10 years. For reference, Jack Kilby won his shared Nobel prize on integrated circuit (IC) that transforms the electronics and computer industry after more than 40 years of the original invention.
Here is a very informative video and blog by Google Cloud Tech team explaining the game-changing nature of the self-attention to understand the contexts of the words being used in any sentences as proposed by the paper [1],[2].
[1] Transformers, explained: Understand the model behind GPT, BERT, and T5:
https://youtu.be/SZorAJ4I-sA https://youtu.be/SZorAJ4I-sA
[2] Corresponding blog post:
https://daleonai.com/transformers-explained https://daleonai.com/transformers-explained
- kristianp 3y agoThere's no nobel prize for Algorthms though. There's no physics involved, unlike the IC. Even if llms turn out to be revolutionary, theres no way a Nobel can be given for Transformers.