3 ms·
> GPT-3 does what it says it does on the sticker. These cherry-picked examples of it not performing “logically” are a misinterpretation of what the model does.
by baryphonic 5y ago
> GPT-3 does what it says it does on the sticker. These cherry-picked examples of it not performing “logically” are a misinterpretation of what the model does.
If it did what it said "on the sticker," it could easily handle these relatively mundane reasoning tasks with ease. The hype that companies like OpenAI and their researchers (and even academic researchers) generate about how revolutionary their new models are is somewhat breathtaking.
Per the sticker, human coders were going the way of the dodo because of GPT-3 as of a couple months ago with Github's autopilot. (So far I have seen no indication anyone has lost their jobs.)
I was at a conference once where Ilya Sutskever demonstrated some music-generation algorithm OpenAI had played with. Frankly, it sounded like garbage. It had no "feeling" or anything memorable beyond just a set of notes that didn't clash when played simultaneously or in sequence. In fact, the only thing memorable was Sutskever's pride in the thing: he was kind of puffing his chest out on stage while we listened to the "composition." I honestly wonder whether to him it sounded like Mozart, Beethoven or Bach.
- lostmsu 5y agoI think you underestimate the number of jumps the size of "pre-Jukebox best to Jukebox" that are required to get from Jukebox to Mozart.