3 ms·
If gaming the metric is a useful behavior, the metric is useless. Secondary infections in hospitals is a good metric. If you game it, it's still a net win for
by bsder 11y ago
If gaming the metric is a useful behavior, the metric is useless.
Secondary infections in hospitals is a good metric. If you game it, it's still a net win for everybody.
Pass rates in schools is a bad metric. I can improve my metric by getting my lowest students to quit.
Rather than trying to "anti-game" a metric, simply observe if the metric is being gamed. If it is, the metric is a priori bad and should be removed.
- danieltillett 11y agoYes this is 100% true, but the point I was making is if the test writes think first about how the metric can be gamed then they can take action to prevent the gaming including changing the metric and test.
- ptaipale 11y ago> If gaming the metric is a useful behavior, the metric is useless. That is exactly why you should have a review of how a metric might be gamed, before you accept to use a this metric.