3 ms·
The article is a critical view on GPT-3. Fair. It is well known that Gary Marcus is not a fan of the GPT kind of systems. And he does make some valid points. If
by nutanc 6y ago
The article is a critical view on GPT-3. Fair. It is well known that Gary Marcus is not a fan of the GPT kind of systems. And he does make some valid points.
If you want to look at a better balanced view it actually helps to look at all their prompts [1].
That said, I think it's more of a hype that GPT-3 is moving towards AGI. The actual GPT-3 paper says "Language Models are Few-Shot Learners"[2]. So it's actually surprising that no one has actually done a real analysis of this. Are they really few shot learners? My experiments seem to suggest otherwise.
But for sure, GPT-3 is the best general purpose natural language system out there in the world. I don't think anyone can say otherwise.
[1]https://cs.nyu.edu/faculty/davise/papers/GPT3CompleteTests.html https://cs.nyu.edu/faculty/davise/papers/GPT3CompleteTests.h...
[2]https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165