Indeed, it's called Goodhart's law. As soon as metric becomes a target, it stops being a good metric. https://en.wikipedia.org/wiki/Goodhart%27s_law https://en

Indeed, it's called Goodhart's law. As soon as metric becomes a target, it stops being a good metric. https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law