3 ms·
One area that OpenAI did not comment on, was the likelihood that the AI-generated content here was itself used in the training data for a later model. Let's sa
by kjellsbells 2y ago
One area that OpenAI did not comment on, was the likelihood that the AI-generated content here was itself used in the training data for a later model.
Let's say the OpenAI engineers are working on ChatGPT 5 and spent last month scraping Teorater and X/Twitter, where this material ended up. How does OpenAI know that the new model is not poisoned?
This isn't just OpenAI's problem of course. Anyone training on the open Internet now has this problem.
- deleted 2y ago[deleted]
- Arrath 2y ago> This isn't just OpenAI's problem of course. Anyone training on the open Internet now has this problem. 'Low-background Steel' has been a nerd trivia tidbit for a while now, will we have to consider a 'Pre' and 'Post' AI internet era for training uses?
- nolroz 2y agoMaybe one of the uses of the generated content detection method that OpenAI supposedly has is they can filter at least some of it out?
- ethbr1 2y agoGiven recent advancements, buying Twitter solely for its use as a data source seems prescient, given only the first party has additional metadata to identify bot replies. ... if the actual purchase hasn't been such a cluster$&@$ so as to thoroughly disabuse the notion there was some master plan.