I am not overly concerned by a future where AI spoils its own training sets. Companies like openai will keep injecting human-generated feedback into the traini

I am not overly concerned by a future where AI spoils its own training sets. Companies like openai will keep injecting human-generated feedback into the training set. A lot of the value is already in the RLHF today. See openai technical report.