First of all, “pre-poisoned” data sets are freely available in archives such as common crawl. Secondly, I doubt the usefulness of that data in the long run. A m

First of all, “pre-poisoned” data sets are freely available in archives such as common crawl. Secondly, I doubt the usefulness of that data in the long run. A model trained on only that old data will forever be stuck in the past. It’ll be like the stereotypical senile grandpa who only talks about the old days and doesn’t know anything about current events.