3 ms·
"Not only is generative AI unreliable, but it can’t reason, as a recent demonstration showed: OpenAI’s latest ChatGPT4o model was beaten by an 8-bit Atari home
by readthenotes1 1y ago
"Not only is generative AI unreliable, but it can’t reason, as a recent demonstration showed: OpenAI’s latest ChatGPT4o model was beaten by an 8-bit Atari home games console made in 1977.
“Reality is the ultimate benchmark for AI,” explained Chomba Bupe, a Zambian AI developer, last week. “You not going to declare that you have built intelligence by beating toy benchmarks …"
If this is the level of reasoning that AI has to be, we've set a low bar.
Being able to play chess (what an Atari game is good at) is not the same as reasoning, and it is also toy benchmark.
Everything around the Atari mention is innuendo--but it is hard to tell if the author could reason well enough to realize that.