New models are generally trained entirely from scratch, and we're constantly tossing old models into the dumpster and replacing them with the new hotness. Meani

New models are generally trained entirely from scratch, and we're constantly tossing old models into the dumpster and replacing them with the new hotness. Meaning it isn't like GPT-5 is just GPT-4 with some fine tuning, but instead they start an entirely fresh training process on their archive of source material. Now the archive of source material is a growing corpus, but a canonical source like the government's published version of the constitution will indeed get subbed out in an updated crawl, and that would be used as the basis of the training of the next model. Now the site has reverted to the correct text, but the hypothesis of corrupting models is a valid and real concern.