3 ms·
Right. Do you have any good recommendations to read on this matter? Here are a couple of good papers on how metrics distort systems and what can be done to mit
by divan 3y ago
Right. Do you have any good recommendations to read on this matter?
Here are a couple of good papers on how metrics distort systems and what can be done to mitigate this. [1] [2].
And then a new post by Cedric Chin on practical examples of mitigating Goodhart's law in Amazon. Really good read: [3]
But generally, I feel like not many people or organizations care about this. The non-profit sports world is conservative and slow, organizations and corporations are also often slow, and there some psychological/social effects linked to the metrics-that-don't-work-anymore.
---
- [1] Categorizing Variants of Goodhart's Law - https://arxiv.org/abs/1803.04585 https://arxiv.org/abs/1803.04585
- [2] Building Less Flawed Metrics: Dodging Goodhart and Campbell's Laws - https://www.researchgate.net/publication/334478956_Building_Less_Flawed_Metrics_Dodging_Goodhart_and_Campbell%27s_Laws https://www.researchgate.net/publication/334478956_Building_...
- [3] https://commoncog.com/goodharts-law-not-useful/ https://commoncog.com/goodharts-law-not-useful/
- munificent 3y agoI don't but I'd love to read them if anyone else does.
- sbierwagen 3y agoSpiritually related: examples of RL algorithms exploiting glitches in the physics engine (clipping into the ground to shoot forward at incredible speed) or gaming the goal state: (Agent that's supposed to learn how to walk instead evolving a body with a single long leg that just falls forward-- getting a high speed score with low complexity penalty) https://arxiv.org/abs/1803.03453 https://arxiv.org/abs/1803.03453 https://www.deepmind.com/blog/specification-gaming-the-flip-side-of-ai-ingenuity https://www.deepmind.com/blog/specification-gaming-the-flip-...
- divan 3y agoGreat work, thank you for sharing!