3 ms·
GPT-2 was the first wake-up call - one that a lot of people slept through. Even within ML circles, there was a lot of skepticism or dismissive attitudes about
by ACCount37 1y ago
GPT-2 was the first wake-up call - one that a lot of people slept through.
Even within ML circles, there was a lot of skepticism or dismissive attitudes about GPT-2 - despite it being quite good at NLP/NLU.
I applaud those who had the foresight to call it out as a breakthrough back in 2019.
- whimsicalism 1y agoi think it was already pretty clear among practitioners by 2018 at the latest
- ACCount37 1y agoIt was obvious that "those AI architectures kick ass at NLP". It wasn't at all obvious that they might go all the way to something like GPT-4. I totally underestimated this back then myself.