4 ms·
Not once in this blog did the author address why OpenAI has chosen to release the model in the way they have and why he disagrees with them, other than the beli
by solidasparagus 7y ago
Not once in this blog did the author address why OpenAI has chosen to release the model in the way they have and why he disagrees with them, other than the belief that 'it's probably not possible to distinguish between GPT-2 and humans so let's not bother giving people a chance to try to develop techniques'. Blithely dismissing what OpenAI is trying to do is incredibly arrogant.
- "And I think no currently existing technique can even scratch the capabilities humans have in this area [detecting truth], even with all of their biases".
This is literally why OpenAI is releasing the model slowly.
- "I really do think that if people just knew that something like GPT2 exists and is out there in the wild, it would force them to improve their standards for what information they trust".
I disagree. Look at how the knowledge that 'shills' and 'russian trolls' exist has shaped online discussions. It becomes an easy way to dismiss things that challenge your worldview, but does not significantly improve their ability to determine veracity.
- "I think we have reached a point where it is no longer, in general, possible to determine whether a given text is human generated or not".
- "It means that even if we had a system that can perfectly detect AI generated babbling and deployed it, it would censor not just AI, but a good chunk of real, human communication as well".
Based on what? This is a very thoughtless dismissal of a very important (and very much unanswered) question. Deep learning often leaves identifiable artifacts, such as deep fakes not blinking. GPT-2 is impressive, but to assume that it is identical to human generated text is a lazy assumption.
- "I’m as anti-war, pro-human as you could imagine, but if I was alive in the 40s, and the US offered me to work on the Bomb…I don’t know if I could have said no. Not because I wanted to hurt people, this is the important thing to understand about the curious hacker, but because it was just so damn cool. Splitting the literal building blocks of matter itself to make a giant explosion? That’s fucking awesome!"
- "a digital 21st century Manhattan project (Which, again, sounds like heaven to me)".
There are no words to describe my disgust at this sentiment. I'm not anti-war, but I think prioritizing 'having fun' over human lives is evil.
- NPCollapse 7y agoThese are some of the best counterarguments I've heard yet. Would you be interested in discussing this at more length over email or DM? I'm sorry I have done and said things you think are wrong. I am genuinely trying to do my best to do what is right.
- solidasparagus 7y agoI'll follow up on this when I have time, but I should say that, while I do stand by everything I said in my post, my tone is harsher than I would like for reasons unrelated to you (I'm in a bad mood).