It might behoove the reader to remind themselves that goodhearts law is a conjecture, not a law. Similar to Poe's Law, it's an observation about something, but

It might behoove the reader to remind themselves that goodhearts law is a conjecture, not a law. Similar to Poe's Law, it's an observation about something, but that doesn't make it universal, or some kind of physical, social, or economic law. In other words, you don't get to assume that the tests aren't measuring the right thing, even if AIs are being designed to do well on the tests. That is a claim that demands evidence.