3 ms·
The OpenAI approach to managing the release of the larger dataset strikes me as totally flawed and upside down. The biggest concern the team seem to have is tha
by revel 7y ago
The OpenAI approach to managing the release of the larger dataset strikes me as totally flawed and upside down. The biggest concern the team seem to have is that the fully trained GPT2 model will be used to spread propaganda and misinformation. They also imply that the biggest hurdle to training a similar model is money needed to pay for the training resources.
The problem with this approach is that the users most likely to be malicious users of GPT2 are state actors. China, for example, already spends millions on an immense propaganda factory. Money is not a serious obstacle for a state. Given that other research entities are, by the sound of things, already far along with development of similar models it seems unlikely that China and the US don't already have functional models internally.
On the other hand, legitimate business and research is clearly hamstrung by withholding the full model. What we have is the maximum degree of inconvenience and the minimum degree of security. It feels almost perfectly analogous to ban on liquids in airports. The motivation for that ban was that existing security measures couldn't detect liquids, but simply announcing a ban was to be enforced didn't change the fact that liquids were undetectable. Instead millions of travelers were pointlessly inconvenienced at great cost.
Release the kraken already!
- Judgmentality 7y agoThey do seem to have a bit of a mismatch between what they say and what they do. They wanted to be the non-profit benefiting humanity with their advanced research, but had to raise money because that wasn't working. And now they claim to have these impressive models, but also claim it's not safe to release them to the public. Okay, so what exactly are you developing that's good for anybody?
- skybrian 7y agoUh, you're forgetting about spammers and malware authors.
- jcims 7y agoI’d recommend re-reading the original GPT2 announcement, particularly this section regarding their release policy: This decision, as well as our discussion of it, is an experiment: while we are not sure that it is the right decision today, we believe that the AI community will eventually need to tackle the issue of publication norms in a thoughtful way in certain research areas. This release approach is an experiment used to force the conversation around a release strategy before we actually and unambiguously need it.