Training data is preprocessed, you know. I don't understand why everybody making this argument ignores that. It's not as if the internet before LLMs did not ha

Training data is preprocessed, you know. I don't understand why everybody making this argument ignores that. It's not as if the internet before LLMs did not have tons of trash content (which also includes things written by humans who sincerely think they're right, but that is factually incorrect). Of course the input data is preprocessed and curated/weighted. Of course newer training data will also be curated. Think for a second about what you said: "I already see material on the open Internet that has very obviously been generated by AI." Why would any AI company worth its salt _not_ ignore such data?