3 ms·

There are entire industries devoted to helping humans overfit on standardized tests. Humans love to overfit, it's often easy and faster to get what you want--wh

• godelski 3y ago
  > Humans love to overfit, it's often easy and faster to get what you want The problem is Goodhart's. Tests aren't used to measure your ability to overfit them, but to measure your general knowledge. Obviously the latter is exceptionally difficult to measure so we settle for an easier metric. The problem comes from believing that the measurement well aligns with the thing we set out to measure. The same is for humans as is for machines and it is why it is insane to say something like "look, GPT did well on the BAR exam, it should be able to practice law." Because we explicitly do not want a legal system that follows the letter of the law (rather spirit of the law) and it's clear which one GPT would do. Yes, there's a problem that humans go this way too, but it's something we can solve if we are willing to admit the fuzziness of our metrics.