3 ms·
I'm not sure where it was originally used, but the attention mechanism in GPT was pretty important for making it all work.
by creatonez 3y ago
I'm not sure where it was originally used, but the attention mechanism in GPT was pretty important for making it all work.
- williamtrask 3y agoPaper you’re looking for is called “Attention is all you need”