All ~models~ measures are wrong, some are useful. I think this result is really cool, and is another way to measure progress in AI capabilities. I don't think

All ~models~ measures are wrong, some are useful. I think this result is really cool, and is another way to measure progress in AI capabilities. I don't think it says much about the absolute position of how "smart" AIs are, but it definitely has value in showing how far it's progressing.