4 ms·
All these metrics are easily manipulated. Test scores can be manipulated by giving easier tests. Measuring number of police call-outs just encourages not callin
by charlieyu1 3y ago
All these metrics are easily manipulated. Test scores can be manipulated by giving easier tests. Measuring number of police call-outs just encourages not calling police on emergencies.
- oogali 3y agohttps://en.wikipedia.org/wiki/Goodhart%27s_law#Generalization https://en.wikipedia.org/wiki/Goodhart%27s_law#Generalizatio...
- londons_explore 3y agoSure, but assuming everyone puts similar amounts of efforts into manipulating the metrics, the model will come to reflect the fact that those metrics are no longer predictive, and there will no longer be a benefit to manipulating them. Thats the benefit of this scheme - it isn't statistically sound, but all the statistical shortcomings eliminate themselves as people try to exploit them.