3 ms·

Gary Marcus predicted that deep learning was "hitting a wall" [1]... right before ChatGPT came out. At this point he's so committed to the bit that he has to ke

Gary Marcus predicted that deep learning was "hitting a wall" [1]... right before ChatGPT came out. At this point he's so committed to the bit that he has to keep predicting that this time, really, it'll stall, and hoping eventually a stall comes. 1: https://nautil.us/deep-learning-is-hitting-a-wall-238440/ https://nautil.us/deep-learning-is-hitting-a-wall-238440/ Also note he doubts that scaling will work past GPT-3... Not uh, 20/20 foresight exactly.

soderfoo 3y ago
When will the “When will the GenAI bubble burst? "bubble burst? I've seen contrarian think pieces like this pop up on social media so much lately they pollute my feed just as much as the GenAI evangelist articles.
- Hoasi 3y ago
  Maybe it just indicates a general AI buzzwords fatigue, regardless of actual progress in the field.
- greg_V 3y ago
  That's a signal that the tide IS turning. I follow some people who went all-in on AI (consultants mostly) and their tone has changed quite a bit in the last few months. Cool new tech that was oversold in terms of what it can do for businesses. A correction is in order.
  - AnimalMuppet 3y ago
    A correction is in order in the short term. We don't yet know what ChatGPT can do in the long term. In the short term, though, it can't do as much as it has been sold as being able to do.
ben_w 3y ago
Do you have statistics on his error rate, or just examples? I'm of the school of thought one should aim to be about 70-80% right: score above that, and the problems you're tackling aren't hard enough; score below that, and you're not good enough to help with the problems.
- reissbaker 3y ago
  His Twitter feed is nonstop, more-than-daily posting that a new AI winter is just around the corner, really, this time. I haven't bothered to count every prediction but he's got at least three 9s of being wrong about this topic and refusing to update his arguments when faced with new evidence.
  - ben_w 3y ago
    Fair enough then. (I don't have a twitter account, so I couldn't learn this myself).
foldr 3y ago
This is a pretty inaccurate summary of the linked article.
tim333 3y ago
I guess you can model Gary as a token predictor writing the most likely token based on his previous published work.

soderfoo 3y ago

When will the “When will the GenAI bubble burst? "bubble burst? I've seen contrarian think pieces like this pop up on social media so much lately they pollute my feed just as much as the GenAI evangelist articles.

Hoasi 3y ago
Maybe it just indicates a general AI buzzwords fatigue, regardless of actual progress in the field.
greg_V 3y ago
That's a signal that the tide IS turning. I follow some people who went all-in on AI (consultants mostly) and their tone has changed quite a bit in the last few months. Cool new tech that was oversold in terms of what it can do for businesses. A correction is in order.
- AnimalMuppet 3y ago
  A correction is in order in the short term. We don't yet know what ChatGPT can do in the long term. In the short term, though, it can't do as much as it has been sold as being able to do.

ben_w 3y ago

Do you have statistics on his error rate, or just examples? I'm of the school of thought one should aim to be about 70-80% right: score above that, and the problems you're tackling aren't hard enough; score below that, and you're not good enough to help with the problems.

reissbaker 3y ago
His Twitter feed is nonstop, more-than-daily posting that a new AI winter is just around the corner, really, this time. I haven't bothered to count every prediction but he's got at least three 9s of being wrong about this topic and refusing to update his arguments when faced with new evidence.
- ben_w 3y ago
  Fair enough then. (I don't have a twitter account, so I couldn't learn this myself).

foldr 3y ago

This is a pretty inaccurate summary of the linked article.

tim333 3y ago

I guess you can model Gary as a token predictor writing the most likely token based on his previous published work.