3 ms·

Indeed. Love it! As usual: Step 1: metric is used to indicate performance Step 2: developer finds a way to hack the metric Step 3: developer profit Step 4:

Indeed. Love it! As usual: Step 1: metric is used to indicate performance Step 2: developer finds a way to hack the metric Step 3: developer profit Step 4: metric now considered unusable LOCs, #of issues fixed, ... all in the same bag.

ordinary 11y ago
https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law
- hebdo 11y ago
  Tell that to people doing machine learning!
  - drdeca 11y ago
    Isn't that kind of why they use a training set and a separate evaluation set?