3 ms·
Everybody should have a lot of experience working within Goodhart's Law, since grades and school tests are such a huge part of everybody's early life. You can
by bryanlarsen 4y ago
Everybody should have a lot of experience working within Goodhart's Law, since grades and school tests are such a huge part of everybody's early life.
You can then apply Joiner's list to school tests as:
1. you can learn your source material
2. you can game the test
3. you can cheat
- vajrabum 4y agoBut notice in a public school environment the hard incentives ($$$) are all on the administration. So, it's attendance, tests and grades, maybe followed by class size. Yes, there's incentives for students to cheat but cheating is much more widespread and likely on the part of the teachers and administration. The blogger didn't talk about this, but you need to look to see for any metric or group of metrics who is incentivized to cheat and how it might manifest.
- amflare 4y agoYou say this like there is an obvious and right way to handle the situation. But the reason such a situation might end up Goodhartable is if you had three tests every day with no time to study. Unless the requirements change, it would be impossible to "succeed" without adopting #2 or #3. This is why the GP is saying this concept is great for a top-down approach, but if you are in a system that doesn't give a shit, then you are forced to play the game or lose to those who do.
- caoilte 4y agoThe thing being distorted is not passing tests, it's education. Learning the source material for tests does not give you a good education.