4 ms·
It's getting pretty old now when Francois Chollet puts out a new ARC challenge, claims definitively that no system is going to crack it without being full blown
by vonneumannstan 7mo ago
It's getting pretty old now when Francois Chollet puts out a new ARC challenge, claims definitively that no system is going to crack it without being full blown AGI, the benchmark gets saturated in a few months, he claims the systems definitely aren't AGI then puts out a new challenge that no non AGI system can clear and a few months later.... etc. etc.
- daveguy 7mo agoChollet literally never says that. Quite the opposite. He says that AIs are currently abysmally bad at the skills this benchmark tests. An AGI should be able to do this, but doing this doesn't mean it's AGI. He has been very clear about that. I suggest you go back and (re)read the intro ARC-AGI paper. No system can crack these out of the box (like humans can) because we don't have AGI.
- vonneumannstan 7mo agoYeah I mean ChatGPT 5.4 Pro can't even pick my nose for me so it's obviously not AGI /s