I think he used the free version. GPT4o did better. It was missing 2 states. GPTo3-mini-high did it correctly in one shot. So this is against what Gary Marcus

I think he used the free version. GPT4o did better. It was missing 2 states. GPTo3-mini-high did it correctly in one shot. So this is against what Gary Marcus is saying. I think his argument falls apart if he's says that we won't have AGI soon because a free model is making mistakes, but ignores that the newer and more expensive model can do what he says. No one said AGI will be cheap in 2-3 years. They're saying it could be achieved in 2-3 years. It could be achieved but require an entire state's electricity to run it inititally.