I'm skeptical of these benchmarks. I mean, look at the problem it's solving? I'm sorry, this is our benchmark of AGI, it will never fly with the common person w

I'm skeptical of these benchmarks. I mean, look at the problem it's solving? I'm sorry, this is our benchmark of AGI, it will never fly with the common person when someone claims AGI, and all it did was fill a grid of pixels. Was it zero-shot at least and Pass@1 ? I guess it was not zero-shot, since it shows examples of other similar problems and their solutions. It also sounds like it was fine-tuned on that specific task. Look, maybe this shows that it could soon be used to replace some MTurk style workers, but I don't know that counts as AGI. To me AGI, it needs to be able to solve novel problems, to adapt to all situations without fine-tuning, and to operate at much larger dimensions, like don't make it a grid of pixels, make it 4k images at least.