In a recent paper [1], I argue that intelligence cannot ever be accurately measured by any one particular game or 'environment', but rather, it's better to thin

In a recent paper [1], I argue that intelligence cannot ever be accurately measured by any one particular game or 'environment', but rather, it's better to think of each such environment as being a voter, with just one vote out of many in the universal "intelligence contest". A bot fine-tuned to dominate Go, or Chess, or whatever, is like a candidate fine-tuned to have perfect appeal to one specific voter. It's no surprise if such a candidate gets that one voter's vote, but it should also be no surprise if such an overtrained candidate performs horribly in the election as a whole. [1] https://philpapers.org/archive/ALEIVU.pdf https://philpapers.org/archive/ALEIVU.pdf