Quite right, and I'd say this could be considered an instance of the phenomenon known as (among other names), Goodhart's Law. If we consider superficial appeara

Quite right, and I'd say this could be considered an instance of the phenomenon known as (among other names), Goodhart's Law. If we consider superficial appearance of success to be a good proxy for success and hence a good metric to optimize for then we necessarily end up moving away from our original goal.