3 ms·
I’m as skeptical of OpenAI as just about anyone, but Marcus just seems to engage in the kind of contrarian ranting that happens to people when they spend too mu
by bugglebeetle 2y ago
I’m as skeptical of OpenAI as just about anyone, but Marcus just seems to engage in the kind of contrarian ranting that happens to people when they spend too much time on social media. I would say a better indication of o3’s performance is François Chollet seeming kind of bummed that LLMs have reached this point, contrary to his expectations.
EDIT:
In the interest of not being overly negative myself, I found Nathan Lambert’s more measured and detailed breakdown far more instructive:
https://www.interconnects.ai/p/openais-o3-the-2024-finale-of-ai https://www.interconnects.ai/p/openais-o3-the-2024-finale-of...
- jagrsw 2y agoChollet's shift in tone is interesting. As recently as 2022, he expressed strong skepticism about LLMs solving ARC-AGI within a decade. Now, he seems to suggest that significant progress on the challenge is possible within the next 1-2 years. Of course, he strives to maintain a consistent public persona, but this shift strongly implies that o3's performance has significantly altered his views. This field, much like economics, is full of experts who can convincingly explain why there were wrong :) PS: ARC-AGI is a very well-though-out/interesting/useful test.
- dimmuborgir 2y agoThe result announcement blog post sounded too hypey and gave the impression that he changed his tone but for the last one year he has been consistently saying that LLM+"discreet program search" is the way to go. All the top scoring submissions before o3 had followed the same bruteforce strategy. Even o3 is more or less doing the same bruteforce under the hood, maybe not discreet.