2 ms·
ARC-AGI, while imagined as super hard for AI, was beaten enough that they had to come up with ARC-AGI-2.
by scotty79 1y ago
ARC-AGI, while imagined as super hard for AI, was beaten enough that they had to come up with ARC-AGI-2.
- hbsbsbsndk 1y ago"AI tend to be brittle and optimized for specific tasks, so we made a new specific task and then someone optimized for it" isn't some kind of gotcha. Once ARC puzzles became a benchmark they ceased to be meaningful WRT "AGI".
- scotty79 1y agoSo if DOTA became a benchmark same way Chess or Go became earlier it would be promptly beaten. It just didn't stick before people moved to more useful "games".