2 ms·
This really is just "Goodhart's Law" in action. We have a saying "all models are wrong" but I think we also need to make the phrase "all metrics are wrong" more
by godelski 3y ago
This really is just "Goodhart's Law" in action. We have a saying "all models are wrong" but I think we also need to make the phrase "all metrics are wrong" more common. Metrics are simply guides. It is also why we say that all rules are mean to be broken. If you rely too heavily on a metric you will only get yourself burned. Unfortunately no matter how good our algorithms are, they won't be any more than a guide. You still unfortunately have to use your brain.