4 ms·
So this type of article is going to be written every time a model is deprecated? GPT-3 is the one that shocked the world. And the main innovation (transformer
by creatonez 1y ago
So this type of article is going to be written every time a model is deprecated?
GPT-3 is the one that shocked the world.
And the main innovation (transformer with attention) predates it by a few years and was already surprising people in GPT-2
- Natfan 1y agoAgreed. For me, GPT-2 was the first time I saw generated text in the wild (thanks r/subredditsimulator!) back in ~2015(?), and GPT-3/ChatGPT was the real model/interface that shocked the world.