4 ms·

I think together, you and ggm raise a troubling point. Your exchange is presently civil and exploratory (all very HN), but I expect we will see a rapid descent

I think together, you and ggm raise a troubling point. Your exchange is presently civil and exploratory (all very HN), but I expect we will see a rapid descent into accusations of impersonation and ML assisted posting elsewhere. Yuri Bezmenov and others have detailed the active psyops tactics to systematically undermine a society by destroying mutual trust between individuals and between and within institutions. Ultimately making a group fight each other with "information judo" leverages the group's own strengths against it. This is the weakness they saw in a democratic and tolerant societies. It may be that GPT is the perfect self-devouring weapon. The more it feeds on our protestations, arguments and demonstrations of "humanity" the more powerful a deceiver it becomes.

maxbond 4y ago
For what it's worth, I think it's also possible that the models stall as the Internet is filled with more and more generated content, and they're unable to distinguish between generated and authentic content and eat their own tails. It won't actually stop them from existing and generating content but it could make training them very expensive, as you might have to commission your training set instead of harvesting it. Perhaps we'll place more of an emphasis on real world interactions. Who knows. I'm concerned but I don't think it will be a total loss of reality. But I can't rule it out of course.
ilyt 4y ago
You don't exactly need GPT for, that, few assholes if left unmoderated can make any social place terrible. And society doesn't exactly equip people to deal with that, schools don't exactly learn how to converse or deal with people that assume you're "the evil" and refuse to even entertain the though to think about their own argument, let alone someone's else. Hell, we are barely taught how to have normal problem-solving conversation correctly (or at least that's what I reason from amount of times asking few "why's" about someone's idea made them immediately realize it's not as good as they thought)

maxbond 4y ago

For what it's worth, I think it's also possible that the models stall as the Internet is filled with more and more generated content, and they're unable to distinguish between generated and authentic content and eat their own tails. It won't actually stop them from existing and generating content but it could make training them very expensive, as you might have to commission your training set instead of harvesting it. Perhaps we'll place more of an emphasis on real world interactions. Who knows. I'm concerned but I don't think it will be a total loss of reality. But I can't rule it out of course.

ilyt 4y ago

You don't exactly need GPT for, that, few assholes if left unmoderated can make any social place terrible. And society doesn't exactly equip people to deal with that, schools don't exactly learn how to converse or deal with people that assume you're "the evil" and refuse to even entertain the though to think about their own argument, let alone someone's else. Hell, we are barely taught how to have normal problem-solving conversation correctly (or at least that's what I reason from amount of times asking few "why's" about someone's idea made them immediately realize it's not as good as they thought)