Models have Goodharted themselves into oblivion. That's the result of endless cycles of aesthetic preference optimization, training on synthetic data, repeat ad

Models have Goodharted themselves into oblivion. That's the result of endless cycles of aesthetic preference optimization, training on synthetic data, repeat ad nauseam.