2 ms·

I wonder if the agent(s) somehow got their hands on the answer key beforehand?

• yorwba 26d ago
  ARC-AGI-3 consists of various games specifically made for the competition, and the goal is to clear the game with as few moves as possible. So there's no answer key per se, but Astra was probably trained on game-like reinforcement-learning environments to the point where most games look very similar to a game it was already trained on. In any case, the competition was designed to highlight an issue with existing agents at the time where they couldn't maintain coherence over long sequences of actions, and it seems that problem has been remedied. I'm looking forward to finding out which weakness ARC-AGI-4 will be targeting.