I don't buy this at all. AI data is a real part of the environment. The thing to modify is the loss function not the training data. You need to be able to evalu

I don't buy this at all. AI data is a real part of the environment. The thing to modify is the loss function not the training data. You need to be able to evaluate text on the internet and so do models. This idea of contamination by AI vs pristine human data isn't persuasive to me at all. It feels like a continuation of the wrong idea that LLMs are parrots.