10 ms·
I think this is the root of it but also why it is so effective. You can never tell when it is happening and when it works correctly it causes people to independ
by godelski 6y ago
I think this is the root of it but also why it is so effective. You can never tell when it is happening and when it works correctly it causes people to independently mimic and generate new content for you. Even better when you push the very topics to the extreme. Either this is being done at such a large scale with such precision that the lizard people effectively are mind controlling the population vs it doesn't happen at all (for what it is worth I'm on the very mundane end of the spectrum). The former I would call gaslighting but I don't have a great term for the latter, maybe someone else does?
Side note: interesting to see you outside your moderator role and thanks for the service to the community and your thoughtful addition to the discussion.
Edit: (You got a ninja edit on me!) I think the point you make about the sufficiently smart enough effect. And I do like that the community here is (imo) much better at self enforcement with good faith arguments. But would not a simple tactic be to encourage the use of bad faith arguments? That seems fairly simple to execute and an easy way to generate a Divide and Rule[0] tactic. But I think when it comes down to it the impossibility to even know is what makes all this both very interesting and frustratingly difficult (as well as effective).
[0] https://en.wikipedia.org/wiki/Divide_and_rule https://en.wikipedia.org/wiki/Divide_and_rule
- AndrewBissell 6y agoWould like to echo your compliments to dang. The only bit of pushback I would make to his point is that if the SSM really does exist, perhaps the correct course of action is to reduce our participation as much as possible and move our engagement to less easily manipulated forms of communication, particularly face-to-face meetings. Perhaps, even if we do our best to post in good faith and make well reasoned, careful arguments, in the end we only lend a superficial credibility to a system which still has a negative effect in the aggregate (because it has been engineered to do so). And yes, I'm aware of the inherent hypocrisy in posting this on a (well!) moderated forum with a system of largely opaque voting and flagging. :-)
- dang 6y ago(Sorry about editing the rug from under you - I write these comments by adding to them bit by bit, but it somehow only 'works' if I do it live.) You're raising an important point which I think about a lot. It's very clear to me that most users who get into intense arguments about divisive topics are sincere. The anger and hurt feelings that energize these arguments and get re-energized by them are too unmistakeable to just be cynically planted. But it may be that these are second-order effects of propaganda systems. If you convince enough people and get them feeling angry and hurt enough, they'll do your job for you, and much better, by being intensely sincere. You can't say that these commenters are manipulators, because they're not. "You're a shill!!" will meet with justified indignation, and "you've been brainwashed!!" is no good either. The whole distinction between "manipulated" vs. "authentic" doesn't address what really goes on in these discussions. You can't use it to make anything better. That's not to say that we should do nothing when we find some real indication of actual manipulation—the opposite is the case. But it doesn't make that much difference when the 'organic' dynamics point in the same direction. Certainly it doesn't solve the problem. Another extremely powerful factor that does the propagandist's work for them in an entirely innocent way is tribalism. Is it manipulation if I feed your beliefs about your identity and (especially) the opposing identity in a way that inflames you with indignation against the enemy? That "food" is so eagerly gobbled by the consumer that at some point you have to ask who's influencing who. The tribal psyche, which we not only all have but are almost totally dominated by, is enough to generate the situation all on its own. Media stories will feed it because that's what people want. No one can get enough of hearing how good their group is and how bad the opposing one is. This force is so powerful that it's not even possible to discuss it, except in the abstract. In my experience, if you take that seriously then you come to feel that such external manipulators as are lurking out there are only effective because they activate the real manipulators, which are inside ourselves. "We have met the enemy and it is us," etc. This perspective is much better because it is empowering: we can do something about it, we can work on it, we can change. The other perspective (external agents are manipulating!) just leads to a wilderness of mirrors, even if external agents doubtless are manipulating. There's nothing we can do about that, except in the important (but relatively rare) case where evidence appears; in the absence of evidence, all we're doing is projecting our shadows onto each other. The reason I think the sufficiently-smart-manipulator argument is a good one is that besides being the only response that can actually work, it points us directly at what we need to be doing anyway, which is addressing these more powerful factors in ourselves. Ok, I'm done editing for the moment :)
- AndrewBissell 6y ago> But it may be that these are second-order effects of propaganda systems. If you convince enough people and get them feeling angry and hurt enough, they'll end up doing your job for you, and much better, simply by being intensely sincere. You can't say that these commenters are manipulators, because they're not. "You're a shill!!" is simply going to meet with justified indignation, and "you've been brainwashed!!" is no good either. This is a really important point and something I try to very consciously and actively resist, not always successfully. The thought "these are all bots" may be a more comforting one to most people than "lots and lots of my fellow human beings have been manipulated into behaving like bots." I would bet an SSM might even have sockpuppets demo and engage in this tactic to encourage divisions.
- godelski 6y agoThese are some really good points. It is reminding me a lot of one of my favorite John Cleese videos[0]. One of the things that I think makes this so difficult is that language has a lot of limits that people don't realize. Since we often don't run into issues with communication (or rather don't notice since the errors are small) it is difficult to realize when we're in boundary cases. For example there's priming[1]. Many may learn that this is a useful way to influence people and many are aware of the psychological experiments, but it is also a fundamental part of how we communicate. We try to communicate the most information with the least amount of words. But this same factor is why good faith arguments are so important but also difficult to maintain. We could not easily converse if we didn't make certain assumptions about another person's views. This is normally fine but we run into problems in heated topics where we often act like someone can only hold an extreme opinion (and of course, mine is not extreme and just common sense). It's the "oh, I've heard this argument before" and while one person may have subtext another may not (why it is difficult to identify dog whistling). Removing nuance from a topic makes it easy, and we like easy things. But that's not beneficial to resolving issues and like you say "leads to a wilderness of mirrors". But it is impossible to tell if priming like this is actively being pushed or naturally happening, since we do have a natural predisposition to form tribes and groups. We're nuanced and thoughtful with our arguments while they are overly simplifying and idiotic. They just want a win while we want to actually fix things. And since this kind of talk is natural it is also almost impossible to figure out if I'm doing the thing I'm actively complaining about or not. [0] https://www.youtube.com/watch?v=HLNhPMQnWu4 https://www.youtube.com/watch?v=HLNhPMQnWu4 [1] https://www.psychologytoday.com/us/basics/priming https://www.psychologytoday.com/us/basics/priming