4 ms·
Goodhart's law suggests that no fixed set of measures will suffice, but what about a dynamic or a set of complementary measures that periodically switch? Spend
by naasking 2y ago
Goodhart's law suggests that no fixed set of measures will suffice, but what about a dynamic or a set of complementary measures that periodically switch? Spend 3-6 months optimizing for X, then spend 3-6 months optimizing for some property complementary to X. Like having metrics that focus on new features, then bug fixes, then new features, etc. Or new features, bug fixes, refactoring/maintenance, new features, bug fixes, etc.
Selecting the set of good and complementary metrics requires careful thought and experimentation, but it might prevent gaming over the long term because the complementary measures of the second phase should make up for deficiencies in the primary measures in the first phase. Anyone have any experience with this sort of thing?