6 ms·

Marcus AI Claims Dataset

64 points by davegoldblatt 7mo ago

barbarr 7mo ago
Can't wait to see Gary Marcus's rebuttal
- dakolli 7mo ago
  Why would he need to make rebuttal, they back up a lot of his claims and show he's becoming more accurate with each year that goes by. The ares where he's less accurate are largely prediction that haven't had time to come to fruition or exaggerated for rhetorical purposes, sometimes you need to use hyperbole to get through to people. I don't know if this will cause a ton of capital destruction, I doubt it, it will probably destroy a bunch of the slot machine/gambling addicts who are paying 5k a month on their credit cards thinking an autocomplete API is going to provide a profitable business. A large part of this is a scam, just like many aspects of crypto were scams while others were not, this hype is very similar to NFT/Crypto hype from 2018-2023. Yes, some things were born out of those industries that are genuinely useful, a lot were not, its the same with AI. Potential AI winter, I think there will be a "winter" just like crypto, but even during crypto's winter, some companies continued to operate and innovate but 90% disappeared. I believe the same thing will happen, and soon. Watch what happens to companies like Perplexity over the next 12-16 months lol.
- oh_my_goodness 7mo ago
  His rebuttal? His critics' rebuttal?
  - barbarr 7mo ago
    I feel he'd want to rebut the use of an LLM for this task to begin with (i.e. find issues/nitpicks with the LLM judgment whether it said he's right or wrong)
dakolli 7mo ago
In 2026, I feel like a painter in 2022 being screamed at non stop by people telling me my craft is soon to be dead, that NFTs are the future by people who are largely behaving like gambling addicts (like NFT people).
bananaflag 7mo ago
Well the main thing he is known for is "it's all gonna crash" and that's a fact that this page admits he's wrong about. Everything else, yeah, he's right, and I never doubted. I agree LLMs are unreliable, insecure etc. But I don't deduce from that that they're gonna amount to nothing.
- albatross79 7mo ago
  Has he said they're going to amount to nothing?
- latexr 7mo ago
  > Well the main thing he is known for is "it's all gonna crash" and that's a fact that this page admits he's wrong about. Have there been specific claims about when it’s going to crash? I find it hard to believe he claimed it was all going to crash by early 2026. Maybe I’m wrong, I haven’t read all of his posts. But neither did the author, they admit in the repo this is all LLM, nothing was verified by humans.
- bayarearefugee 7mo ago
  Obviously I don't speak for Gary Marcus, but I'd say the chances of an AI financial crash aren't really directly linked to whether or not LLMs amount to anything or nothing. From my perspective, it is basically guaranteed that LLMs will increasingly be seen as essential work tools for just about anyone doing knowledge work. So they won't amount to nothing. But it is not at all guaranteed that the frontier model companies who are currently burning billions of dollars chasing that will capture significant percentages of that value.
bionhoward 7mo ago
surprisingly accurate! Is Gary the AI equivalent of the “nothing ever happens” guy?
latexr 7mo ago
> All verdicts are LLM-scored, not human-verified. In other words, could be all slop. Or maybe it’s not. Maybe it’s mixed. No one knows.
- davegoldblatt 7mo ago
  Fair critique. The methodology doc covers this: both pipelines agree on the high-confidence clusters (security vulnerabilities, bubble predictions) even though they disagree on edge cases. The repo is public specifically so people can spot-check. If you find a claim where the scoring is wrong, I'd genuinely like to know.
  - latexr 7mo ago
    > If you find a claim where the scoring is wrong, I'd genuinely like to know. So you’re asking me to do the work you should have done in the first place? If you didn’t put any effort into it, why should I waste my time checking your non-work and correcting it to your credit? If you had actually put in the effort then sure, I’d be amenable to helping making this the best it can be. But you didn’t, so what’s the point? Why should anyone spend their time fixing other people’s slop?
- downboots 7mo ago
  I am curious whether claims are scored more accurately by LLMs when reviewed and edited by LLMs prior to posting the claim.
d_silin 7mo ago
I don't think there will be any market crashes before major AI companies doing IPOs, and then for some time more (late 2027- mid 2028).
- dakolli 7mo ago
  Well, many will crash before they ever get to IPO. Phind closed shop last month a few weeks after raising millions. But yes, the areas where they are claiming he's wrong, have largely not had time to come to fruition. Lets reevaluate his claims about scams and markets in a year. I'd bet my net worth that Perplexity and similar wrapper products are acquired out of existence in <16 months.
albatross79 7mo ago
Sounds about right, boosters are always vaguely claiming he's been obviously and ridiculously wrong, but when you actually listen to him he's tracked very well with the state of AI. GPT 5 was supposed to be AGI remember?
- logicprog 7mo ago
  I think it's pretty clear that he hasn't kept up with the state of the art. He has no idea what coding agents are capable of or how useful they are; he doesn't pay attention to any of the contributions to math or science that these models are making; he continually assists that because agents aren't ready to face customers in uncontrolled environment, they're completely useless even for employees and workers; he just last year posted an article complaining that LLMs don't use web search to find information (he asked the information about a friend), when almost all of them do now, even in their default interfaces; he still thinks hallucinations are a problem with any weight in things like mathematics and programming where it's very easy to verify the types of things hallucinations would cause a problem with; I think he still adheres to the stochastic parrot mindset even though that's not even the most relevant part of their training anymore. Most importantly, although he seems to have made a single substack post making this argument, it doesn't seem to have really percolated through the rest of his thinking: that the cutting edge of LLMs right now, agents, are actually exactly the kind of neurosymbolic system, where neural networks provide an interface with the outside world and a creativity and problem-solving engine to provide the sort of fuzzy pattern matching and adaptability that is needed, while symbolic code-based systems ensure that guardrails are met, requirements are met, and for accurate information is provided and so on, that he wants. I think his objection might be that the problem is that the problem solving and reasoning engine at the core is still an LLM. But the thing is that you need the kind of pattern matching and flexibility and adaptability that you get from an LLM drive things, to have the end result be anything different than just an expert system with a slightly better natural language interface pasted on. And I think it's pretty clear at this point that expert systems are dead. They haven't done anything as remotely interesting or useful as what we're seeing LLMs do. I think like another commenter says that his whole stick is pointing out obviously true basic features of LLMs like that they hallucinate or don't perfectly adhere to prompt guardrails, or that there's too much hype in the industry right now, and a lot of the companies suck in a vaguely standard big tech Silicon Valley way, and extrapolating to some broader point, which is that everyone should have listened to him and done what he said when he wrote that book back in the 90s (iirc).
atleastoptimal 7mo ago
His whole thing is to make obvious incontestable claims about AI (LLM’s make mistakes) and connect it to unfalsifiable grand prognostications (It’s all gonna crash… any day now). Its the same tactic any preacher who harps on about the impending apocalypse uses.
- oh_my_goodness 7mo ago
  What's your take on TFA then?
  - atleastoptimal 7mo ago
    His increasing accuracy derives from him wisening up and criticizing LLM’s only in domains where there is a consensus, and keeping his more grand criticisms unfalsifiable.
  - 1123581321 7mo ago
    I’m not the OP, and haven’t read much Marcus, but an analysis linking “chains of claims” together could be interesting, devaluing specific true claims when they are used to support a false claim. The claims dataset appears to evaluate each claim independently.
dvt 7mo ago
I'm still not sure I fully understand the methodology. For example if Marcus makes the claim: "OpenAI sucks!" why would OpenAI's blog ever corroborate that? The sources used are all AI company blogs (Anthropic, Google, OpenAI) filled with inoffensive corpo-speak likely written to be as middle-of-the-ground as possible. In fact, I'd need an A/B test to make sure the LLM itself can properly rate various claims (positive, negative, and neutral) against such corporate sludge. Small aside: I'm only bringing this up because last year I worked on a game where you had to solve various moral dilemmas in a 1v1 situation (think trolley experiment and one player says "flip the switch" and the other says "don't flip the switch")—the idea was to get an LLM to rate the arguments in a fun turn-based online game. I built it out, but I kind of gave up when I realize how absolutely awful the LLM was at actually rating arguments and their nuances. Who won legitimately felt more like rolling a dice than a verdict given by a real judge or a philosophy professor grading a paper. I put that project aside, but might do a Show HN at some point since the game is basically done. Adjudication[1]—which is the real meat of this project—is done in a very partial way and I genuniely see basically zero value. Why not crawl reddit (or HN)? I know that also has issues, but it at least has more variety of tone. [1] https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/outputs/chatgpt/tables/chatgpt_adjudicable_only.csv https://github.com/davegoldblatt/marcus-claims-dataset/blob/...
- davegoldblatt 7mo ago
  [flagged]
  - dvt 7mo ago
    Gotcha', but I'm just trying to see the audit for how claim X was rated and based on what sources. If we're looking at the Claude logs, we have huge files that have things like this[1]: {"id": "claim_0081", "date": "2023-02-11", "claim": "Current Level 2 self-driving operates under easy conditions and is nowhere close to handling real-world complexity.", "type": "descriptive", "target": "Level 2 self-driving", "status": "supported", "horizon": null} Why is this supported? How is this supported? Waymo would probably disagree, etc. Here's another one: {"id": "claim_0083", "date": "2023-02-11", "claim": "Tesla's product naming ('Autopilot', 'Full Self Driving') misleads customers into thinking the cars are more capable than they are, potentially causing accidents and deaths.", "type": "causal", "target": "Tesla marketing", "status": "supported", "horizon": null} I fully agree that TSLA engages in all kinds of deceptive marketing, but to fully support the stunning claim that it potentially causes deaths is, uh, a bit much. I mean, at least tell me who's saying this. What's the provenance? If Claude itself rated the claims, which seems the be the case unless I'm totally off base, I fail to see how we're actually doing anything at all here. Right now I'm working on a local research agent, and I'm being absolutely meticulous about storing browsed webpages, snippets, etc. into short-term (session) LLM memory or a long-term (cross-session) SQLite db. [1] https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/claude/claude_claims_condensed.jsonl https://github.com/davegoldblatt/marcus-claims-dataset/blob/...
ripped_britches 7mo ago
Strange, I had the same thought about doing this exact exercise this weekend. I think the overall percentage is the wrong approach here. It’s easy to say a lot of things that are factually true or predictions that are inevitably true. However the more salient point with Gary Marcus is the one unforgivable thing he was wrong about and continues to double down on which is that deep learning is hitting a wall. Starting in early 2022 and going through today, there is still so much low hanging fruit with deep learning. Today’s LLM progress is mostly being made in RL. But world models are also still so early and they’re deep learning all the way down. It would be nice if he would just admit he was wrong.
- deleted 7mo ago
  [deleted]
- cl42 7mo ago
  I'll add one more point. If you scroll through his Substack, a lot of his posts are incredibly negative and unproductive. I was (and continue to be) someone who cares deeply about responsible AI... But there's a difference between working on AI responsibly or pushing the debate, versus simply criticizing everything that is done as folly, useless, crap, etc.
- davegoldblatt 7mo ago
  [flagged]
- emp17344 7mo ago
  Is “world models” even a real thing, or just the latest AI buzzword?
  - downboots 7mo ago
    A world model is an attempt at ensuring your hallucinations are compatible with reality https://www.nvidia.com/en-us/glossary/world-models/ https://www.nvidia.com/en-us/glossary/world-models/ usage of the term seems to be correlated with GPU sales https://news.ycombinator.com/item?id=47232306 https://news.ycombinator.com/item?id=47232306
whattheheckheck 7mo ago
Now do this for every single person with actual power
hdgx63 7mo ago
Now do the Pentagon. Gary Marcus is uninteresting cause he has no Power over anything.
camerons03 7mo ago
Piping a few hundred Substack posts through Claude and ChatGPT and slapping a "hybrid reconciliation layer" on top doesn't magically turn token prediction into empirical evidence. Someone is so thin-skinned about a single guy writing a skeptical Substack that they spent their weekend building a dual-pipeline automation tool, scraping four years of his writing, instead of just building a product that actually disproves him. I’m not saying I agree with everything the man says, but until a human actually verifies these verdicts, this is just burnt tokens.
rvz 7mo ago
That's if you trust and believe that the LLMs themselves are 'correctly' scoring. I wouldn't immediately even agree with an assessment made by these LLMs if I were Gary Marcus as that could immediately contradict any of the claims he even made and falling into the trustworthy trap. I'd remain skeptical as ever... ...because this is the worst of the red flags that ultimately supports Gary's argument that the LLM results may be untrustworthy: All verdicts are LLM-scored, not human-verified. People should check for themselves and draw their own conclusions. > The crash hasn't come. yet.
logicprog 7mo ago
I think the problem here is that most of his claims are obvious, uninteresting, and largely agreed with even by the biggest AI hype people, like that AI hallucinates, or that they don't perfectly follow guardrails in the system prompt, or that they can be prompt injected, or that Open AI's financials look bad. But then on the other hand, he completely ignores all of the developments in the field scaffolding around these systems in order to resolve these problems. All of the changes and developments in how these models are trained, all of the things they've actually been able to achieve and do, and basically all of the positive use cases and things that balance out his criticisms. Since he doesn't really talk about any of that, of course he doesn't make false claims about it, he just ignores it, implicitly creating a false picture. And then it is this false picture that he uses to justify his grandiose claims about how everyone should have listened to him about how to do AI and these systems are inevitably going to turn out to be useless and the whole industry is going to collapse and fully disappear and society is going to be ruined and so on. So, of course, it looks like, on the one hand, all of his specific claims about AI are perfectly correct, and on the other hand, that all of his grinder claims about what that implies or means about the industry you have turned out to be wrong, and that he spends much more time on the latter than the former. I think it is really crucial to emphasize that even though most of the individual claims he makes are correct, he spends much more time on the prognostications that are fundamentally not correct, or at least are very speculative right now. I think that's an indication of something gone very wrong with someone's epistemic and incentive situation.
cortesi 7mo ago
I'm sorry, but we can tell absolutely nothing about Gary Marcus from this. People should have a look at the final data: https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/claude/claude_claims_final.jsonl https://github.com/davegoldblatt/marcus-claims-dataset/blob/... Many of the "supported" claims here are vague, banal, obvious, or just opinion. E.g. "the general public hasn't quite realized what's not possible yet" "loads of things scale, but not at all" "To be sentient is to be aware of yourself in the world; LaMDA simply isn't." "To date, nobody, ever, has given a convincing and thorough account of how human children (and human children alone) learn language." "A cat holding a remote control shouldn't have a human hand." "What I didn't see last night was vision" (about Tesla Optimus)
nurettin 7mo ago
You need to be a special kind of troll to use LLMs to respond to someone whose entire online persona is built around "AI bubble".
akssassin907 7mo ago
[flagged]

64 points by davegoldblatt 7mo ago

barbarr 7mo ago

Can't wait to see Gary Marcus's rebuttal

dakolli 7mo ago
Why would he need to make rebuttal, they back up a lot of his claims and show he's becoming more accurate with each year that goes by. The ares where he's less accurate are largely prediction that haven't had time to come to fruition or exaggerated for rhetorical purposes, sometimes you need to use hyperbole to get through to people. I don't know if this will cause a ton of capital destruction, I doubt it, it will probably destroy a bunch of the slot machine/gambling addicts who are paying 5k a month on their credit cards thinking an autocomplete API is going to provide a profitable business. A large part of this is a scam, just like many aspects of crypto were scams while others were not, this hype is very similar to NFT/Crypto hype from 2018-2023. Yes, some things were born out of those industries that are genuinely useful, a lot were not, its the same with AI. Potential AI winter, I think there will be a "winter" just like crypto, but even during crypto's winter, some companies continued to operate and innovate but 90% disappeared. I believe the same thing will happen, and soon. Watch what happens to companies like Perplexity over the next 12-16 months lol.
oh_my_goodness 7mo ago
His rebuttal? His critics' rebuttal?
- barbarr 7mo ago
  I feel he'd want to rebut the use of an LLM for this task to begin with (i.e. find issues/nitpicks with the LLM judgment whether it said he's right or wrong)

dakolli 7mo ago

In 2026, I feel like a painter in 2022 being screamed at non stop by people telling me my craft is soon to be dead, that NFTs are the future by people who are largely behaving like gambling addicts (like NFT people).

bananaflag 7mo ago

Well the main thing he is known for is "it's all gonna crash" and that's a fact that this page admits he's wrong about. Everything else, yeah, he's right, and I never doubted. I agree LLMs are unreliable, insecure etc. But I don't deduce from that that they're gonna amount to nothing.

albatross79 7mo ago
Has he said they're going to amount to nothing?
latexr 7mo ago
> Well the main thing he is known for is "it's all gonna crash" and that's a fact that this page admits he's wrong about. Have there been specific claims about when it’s going to crash? I find it hard to believe he claimed it was all going to crash by early 2026. Maybe I’m wrong, I haven’t read all of his posts. But neither did the author, they admit in the repo this is all LLM, nothing was verified by humans.
bayarearefugee 7mo ago
Obviously I don't speak for Gary Marcus, but I'd say the chances of an AI financial crash aren't really directly linked to whether or not LLMs amount to anything or nothing. From my perspective, it is basically guaranteed that LLMs will increasingly be seen as essential work tools for just about anyone doing knowledge work. So they won't amount to nothing. But it is not at all guaranteed that the frontier model companies who are currently burning billions of dollars chasing that will capture significant percentages of that value.

bionhoward 7mo ago

surprisingly accurate! Is Gary the AI equivalent of the “nothing ever happens” guy?

latexr 7mo ago

> All verdicts are LLM-scored, not human-verified. In other words, could be all slop. Or maybe it’s not. Maybe it’s mixed. No one knows.

davegoldblatt 7mo ago
Fair critique. The methodology doc covers this: both pipelines agree on the high-confidence clusters (security vulnerabilities, bubble predictions) even though they disagree on edge cases. The repo is public specifically so people can spot-check. If you find a claim where the scoring is wrong, I'd genuinely like to know.
- latexr 7mo ago
  > If you find a claim where the scoring is wrong, I'd genuinely like to know. So you’re asking me to do the work you should have done in the first place? If you didn’t put any effort into it, why should I waste my time checking your non-work and correcting it to your credit? If you had actually put in the effort then sure, I’d be amenable to helping making this the best it can be. But you didn’t, so what’s the point? Why should anyone spend their time fixing other people’s slop?
downboots 7mo ago
I am curious whether claims are scored more accurately by LLMs when reviewed and edited by LLMs prior to posting the claim.

d_silin 7mo ago

I don't think there will be any market crashes before major AI companies doing IPOs, and then for some time more (late 2027- mid 2028).

dakolli 7mo ago
Well, many will crash before they ever get to IPO. Phind closed shop last month a few weeks after raising millions. But yes, the areas where they are claiming he's wrong, have largely not had time to come to fruition. Lets reevaluate his claims about scams and markets in a year. I'd bet my net worth that Perplexity and similar wrapper products are acquired out of existence in <16 months.

albatross79 7mo ago

Sounds about right, boosters are always vaguely claiming he's been obviously and ridiculously wrong, but when you actually listen to him he's tracked very well with the state of AI. GPT 5 was supposed to be AGI remember?

logicprog 7mo ago
I think it's pretty clear that he hasn't kept up with the state of the art. He has no idea what coding agents are capable of or how useful they are; he doesn't pay attention to any of the contributions to math or science that these models are making; he continually assists that because agents aren't ready to face customers in uncontrolled environment, they're completely useless even for employees and workers; he just last year posted an article complaining that LLMs don't use web search to find information (he asked the information about a friend), when almost all of them do now, even in their default interfaces; he still thinks hallucinations are a problem with any weight in things like mathematics and programming where it's very easy to verify the types of things hallucinations would cause a problem with; I think he still adheres to the stochastic parrot mindset even though that's not even the most relevant part of their training anymore. Most importantly, although he seems to have made a single substack post making this argument, it doesn't seem to have really percolated through the rest of his thinking: that the cutting edge of LLMs right now, agents, are actually exactly the kind of neurosymbolic system, where neural networks provide an interface with the outside world and a creativity and problem-solving engine to provide the sort of fuzzy pattern matching and adaptability that is needed, while symbolic code-based systems ensure that guardrails are met, requirements are met, and for accurate information is provided and so on, that he wants. I think his objection might be that the problem is that the problem solving and reasoning engine at the core is still an LLM. But the thing is that you need the kind of pattern matching and flexibility and adaptability that you get from an LLM drive things, to have the end result be anything different than just an expert system with a slightly better natural language interface pasted on. And I think it's pretty clear at this point that expert systems are dead. They haven't done anything as remotely interesting or useful as what we're seeing LLMs do. I think like another commenter says that his whole stick is pointing out obviously true basic features of LLMs like that they hallucinate or don't perfectly adhere to prompt guardrails, or that there's too much hype in the industry right now, and a lot of the companies suck in a vaguely standard big tech Silicon Valley way, and extrapolating to some broader point, which is that everyone should have listened to him and done what he said when he wrote that book back in the 90s (iirc).

atleastoptimal 7mo ago

His whole thing is to make obvious incontestable claims about AI (LLM’s make mistakes) and connect it to unfalsifiable grand prognostications (It’s all gonna crash… any day now). Its the same tactic any preacher who harps on about the impending apocalypse uses.

oh_my_goodness 7mo ago
What's your take on TFA then?
- atleastoptimal 7mo ago
  His increasing accuracy derives from him wisening up and criticizing LLM’s only in domains where there is a consensus, and keeping his more grand criticisms unfalsifiable.
- 1123581321 7mo ago
  I’m not the OP, and haven’t read much Marcus, but an analysis linking “chains of claims” together could be interesting, devaluing specific true claims when they are used to support a false claim. The claims dataset appears to evaluate each claim independently.

dvt 7mo ago

I'm still not sure I fully understand the methodology. For example if Marcus makes the claim: "OpenAI sucks!" why would OpenAI's blog ever corroborate that? The sources used are all AI company blogs (Anthropic, Google, OpenAI) filled with inoffensive corpo-speak likely written to be as middle-of-the-ground as possible. In fact, I'd need an A/B test to make sure the LLM itself can properly rate various claims (positive, negative, and neutral) against such corporate sludge. Small aside: I'm only bringing this up because last year I worked on a game where you had to solve various moral dilemmas in a 1v1 situation (think trolley experiment and one player says "flip the switch" and the other says "don't flip the switch")—the idea was to get an LLM to rate the arguments in a fun turn-based online game. I built it out, but I kind of gave up when I realize how absolutely awful the LLM was at actually rating arguments and their nuances. Who won legitimately felt more like rolling a dice than a verdict given by a real judge or a philosophy professor grading a paper. I put that project aside, but might do a Show HN at some point since the game is basically done. Adjudication[1]—which is the real meat of this project—is done in a very partial way and I genuniely see basically zero value. Why not crawl reddit (or HN)? I know that also has issues, but it at least has more variety of tone. [1] https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/outputs/chatgpt/tables/chatgpt_adjudicable_only.csv https://github.com/davegoldblatt/marcus-claims-dataset/blob/...

davegoldblatt 7mo ago
[flagged]
- dvt 7mo ago
  Gotcha', but I'm just trying to see the audit for how claim X was rated and based on what sources. If we're looking at the Claude logs, we have huge files that have things like this[1]: {"id": "claim_0081", "date": "2023-02-11", "claim": "Current Level 2 self-driving operates under easy conditions and is nowhere close to handling real-world complexity.", "type": "descriptive", "target": "Level 2 self-driving", "status": "supported", "horizon": null} Why is this supported? How is this supported? Waymo would probably disagree, etc. Here's another one: {"id": "claim_0083", "date": "2023-02-11", "claim": "Tesla's product naming ('Autopilot', 'Full Self Driving') misleads customers into thinking the cars are more capable than they are, potentially causing accidents and deaths.", "type": "causal", "target": "Tesla marketing", "status": "supported", "horizon": null} I fully agree that TSLA engages in all kinds of deceptive marketing, but to fully support the stunning claim that it potentially causes deaths is, uh, a bit much. I mean, at least tell me who's saying this. What's the provenance? If Claude itself rated the claims, which seems the be the case unless I'm totally off base, I fail to see how we're actually doing anything at all here. Right now I'm working on a local research agent, and I'm being absolutely meticulous about storing browsed webpages, snippets, etc. into short-term (session) LLM memory or a long-term (cross-session) SQLite db. [1] https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/claude/claude_claims_condensed.jsonl https://github.com/davegoldblatt/marcus-claims-dataset/blob/...

ripped_britches 7mo ago

Strange, I had the same thought about doing this exact exercise this weekend. I think the overall percentage is the wrong approach here. It’s easy to say a lot of things that are factually true or predictions that are inevitably true. However the more salient point with Gary Marcus is the one unforgivable thing he was wrong about and continues to double down on which is that deep learning is hitting a wall. Starting in early 2022 and going through today, there is still so much low hanging fruit with deep learning. Today’s LLM progress is mostly being made in RL. But world models are also still so early and they’re deep learning all the way down. It would be nice if he would just admit he was wrong.

deleted 7mo ago
[deleted]
cl42 7mo ago
I'll add one more point. If you scroll through his Substack, a lot of his posts are incredibly negative and unproductive. I was (and continue to be) someone who cares deeply about responsible AI... But there's a difference between working on AI responsibly or pushing the debate, versus simply criticizing everything that is done as folly, useless, crap, etc.
davegoldblatt 7mo ago
[flagged]
emp17344 7mo ago
Is “world models” even a real thing, or just the latest AI buzzword?
- downboots 7mo ago
  A world model is an attempt at ensuring your hallucinations are compatible with reality https://www.nvidia.com/en-us/glossary/world-models/ https://www.nvidia.com/en-us/glossary/world-models/ usage of the term seems to be correlated with GPU sales https://news.ycombinator.com/item?id=47232306 https://news.ycombinator.com/item?id=47232306

whattheheckheck 7mo ago

Now do this for every single person with actual power

hdgx63 7mo ago

Now do the Pentagon. Gary Marcus is uninteresting cause he has no Power over anything.

camerons03 7mo ago

Piping a few hundred Substack posts through Claude and ChatGPT and slapping a "hybrid reconciliation layer" on top doesn't magically turn token prediction into empirical evidence. Someone is so thin-skinned about a single guy writing a skeptical Substack that they spent their weekend building a dual-pipeline automation tool, scraping four years of his writing, instead of just building a product that actually disproves him. I’m not saying I agree with everything the man says, but until a human actually verifies these verdicts, this is just burnt tokens.

rvz 7mo ago

That's if you trust and believe that the LLMs themselves are 'correctly' scoring. I wouldn't immediately even agree with an assessment made by these LLMs if I were Gary Marcus as that could immediately contradict any of the claims he even made and falling into the trustworthy trap. I'd remain skeptical as ever... ...because this is the worst of the red flags that ultimately supports Gary's argument that the LLM results may be untrustworthy: All verdicts are LLM-scored, not human-verified. People should check for themselves and draw their own conclusions. > The crash hasn't come. yet.

logicprog 7mo ago

I think the problem here is that most of his claims are obvious, uninteresting, and largely agreed with even by the biggest AI hype people, like that AI hallucinates, or that they don't perfectly follow guardrails in the system prompt, or that they can be prompt injected, or that Open AI's financials look bad. But then on the other hand, he completely ignores all of the developments in the field scaffolding around these systems in order to resolve these problems. All of the changes and developments in how these models are trained, all of the things they've actually been able to achieve and do, and basically all of the positive use cases and things that balance out his criticisms. Since he doesn't really talk about any of that, of course he doesn't make false claims about it, he just ignores it, implicitly creating a false picture. And then it is this false picture that he uses to justify his grandiose claims about how everyone should have listened to him about how to do AI and these systems are inevitably going to turn out to be useless and the whole industry is going to collapse and fully disappear and society is going to be ruined and so on. So, of course, it looks like, on the one hand, all of his specific claims about AI are perfectly correct, and on the other hand, that all of his grinder claims about what that implies or means about the industry you have turned out to be wrong, and that he spends much more time on the latter than the former. I think it is really crucial to emphasize that even though most of the individual claims he makes are correct, he spends much more time on the prognostications that are fundamentally not correct, or at least are very speculative right now. I think that's an indication of something gone very wrong with someone's epistemic and incentive situation.

cortesi 7mo ago

I'm sorry, but we can tell absolutely nothing about Gary Marcus from this. People should have a look at the final data: https://github.com/davegoldblatt/marcus-claims-dataset/blob/main/claude/claude_claims_final.jsonl https://github.com/davegoldblatt/marcus-claims-dataset/blob/... Many of the "supported" claims here are vague, banal, obvious, or just opinion. E.g. "the general public hasn't quite realized what's not possible yet" "loads of things scale, but not at all" "To be sentient is to be aware of yourself in the world; LaMDA simply isn't." "To date, nobody, ever, has given a convincing and thorough account of how human children (and human children alone) learn language." "A cat holding a remote control shouldn't have a human hand." "What I didn't see last night was vision" (about Tesla Optimus)

nurettin 7mo ago

You need to be a special kind of troll to use LLMs to respond to someone whose entire online persona is built around "AI bubble".

akssassin907 7mo ago

[flagged]