I realized that halfway through typing that too. As well as the absurdity of trying to create AIs that exceed a human in all tasks. On a serious note, most of

I realized that halfway through typing that too. As well as the absurdity of trying to create AIs that exceed a human in all tasks. On a serious note, most of these AIs are bad at math but good at writing code for calculators. So what you'll be benchmarking is their ability to create and use tools.