7 ms·
The effect of deplatforming hate organizations on their online audience
- andreygrehov 3y agoWhat is a hate organization?
- kachnuv_ocasek 3y ago> Organizations that proclaim a violent mission, engage in violence, and represent ideologies that promote hate
- omginternets 3y ago>represent ideologies that promote hate What's that, precisely?
- icandoit 3y agoOrganizations that call for violence. Harming people or the destruction of property. Specific organization would include KKK and ISIS. I would also include organizations that use terrorism to further theier ends of environmentalism and animal rights. What is your goal with this line of argument. This looks a lot like devils advocacy. Like, what good comes from someone saying: "There's actually no such thing as hate-organizations." (Something you never said).
- catiopatio 3y agoIs an organization that advocates for sex-based segregation of sports a hate group? According to some people, they’re advocating for actively harming people. According to others, they’re advocating for preventing harm.
- master-lincoln 3y agoI would say that can not be answered by just looking at the agenda both groups want to push. It depends on how they do it. Advocating for something is not hate
- Veen 3y agoI think a lot of the negative reactions to this paper are because people don't trust corporations and academics to determine what is hateful and what is not. And why should they? It's not that anyone thinks there are no hate groups or that the tactics outlined in the paper don't work, but that such tactics are likely to be abused by people in power to silence ideological opponents.
- omginternets 3y agoMy goal is to suggest that so-worded, a lot of organizations that aren't akin to the KKK an ISIS can be lumped into the same category, and often are. Here's a question for you: do you consider so-called "TERFs" to be a hate-group? And here's another: what do you do with the fact that the very notion of violence is being redefined to include such things as misgendering people? So I ask you this: are you really suggesting it's unreasonable to view this kind of research with caution and circumspection?
- master-lincoln 3y agoIs that a logical AND between all of those? Because if it's a logical OR, butchers might fall into the first 2 categories. And the last part is not very enlightening to define a hate group as it also uses the word hate again
- deleted 3y ago[deleted]
- dragontamer 3y ago[flagged]
- RobotToaster 3y agoso a "hate organization" is a "Hate-based ... organizations"? That clears everything up.
- gunapologist99 3y ago> Did you not read the article at all? Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that". https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html > ... organizations attempt to use online platforms to spread their ideology, recruit new members, and coordinate existing members Essentially all organizations do that, don't they? Did the article define what "hate" is?
- dragontamer 3y ago> Essentially all organizations do that, don't they? Hebrews don't. Plenty of groups don't plan to expand at all actually. Groups explicitly trying to spread hate and grow is key IMO. It separates you out from many other groups.
- AnthonyMouse 3y ago> Hebrews don't. Hence "essentially all" and not "all". Jehovah's Witnesses do, are they a hate group? Environmentalists? Libertarians? Socialist organizations? There are environmentalists who seriously hate people who drive cars. Like call them murderers and want them to suffer. But also, what is a group? Are feminists a group? If there exist self-described feminists who expressly advocate the killing of men, do we then take some action against anyone else who calls themselves a feminist or argues in favor of other feminist positions?
- stirfish 3y ago
- wslack 3y agoDefined here as linked from a study footnote, for things like advocating for violence against civilians: https://transparency.fb.com/policies/community-standards/dangerous-individuals-organizations/ https://transparency.fb.com/policies/community-standards/dan...
- IIAOPSW 3y agoWell generally speaking, its a group of people organized around their shared interest in hating some other people.
- IIAOPSW 3y agoWell generally, its a group of people organized around a shared interest in hating some other group of people. Not much different from asking "what's a woodworking organization?" or "whats a criminal organization?"
- flir 3y agoOne really good way to derail a discussion you're ideologically opposed to us to get in early and deflect it into a discussion about definitions. Someone's bound to fall for it. (Posted in the expectation that someone will be along soon with a bucket and mop).
- stirfish 3y ago[flagged]
- ThrowawayTestr 3y agoSo, feminism?
- icandoit 3y agoWould you accept a definition that includes the KKK and ISIS? If the majority of an organizations public rhetoric is hate for other groups would you agree that makes them a hate organization? What is the purpose of this line of argumentation? Would you take the position that there are no such things as hate-organizations or hate-speech? The world is plainly better off with fewer organizations like the KKK and ISIS. Do you agree? That seems like as milquetoast as one can get. Are there organizations that you feel are labeled as hate-groups but are not? What hairs are we trying to split?
- megaman821 3y agoI kinda want to know the lines we are drawing here. Is a group advocating straight marriage a hate group? Is a group espousing all white people are racist a hate group? Also, I don't this paper is talking about the KKK or ISIS since I don't think they have a had presence on a social platform for quite a while.
- smsm42 3y agoObviously not. Definition "any organization" includes KKK and ISIS, but not acceptable. Same for definition "any organization which includes men". Now, if you defined as "only KKK and ISIS"... still not clear. Which KKK? There were many of them. What if some organization is named KKK but isn't related to US racist one? What about racists that aren't holding a formal membership of KKK - are they fine (if they steer clear of ISIS too)? Giving two examples which seem obvious to you (even those aren't as simple as yoh think) is not the same as giving workable definition. Obviously also there are plenty of organizations that are labeled as hate by some people and other people disagree with it. Look up this week's controversy about SPLC for some examples, but they are in no way unique. You think of it as splitting hairs because you can't imagine how people can disagree with what you imagine to be obvious. But it's not as obvious as you think.
- icandoit 3y ago> But it's not as obvious as you think. If a person or organization calls for violence or the destruction of property, they are a terrorist organization. If the reasons they give for this are based on identity they are additionally a hate-group. Seems pretty clear to me. A world with less moral clarity here is one with more (necessarily?) violence and destruction. Why do you think this line of argumentation is either morally permissable, or even virtuous? What argument convinced you?
- smsm42 3y agoObviously, an organization violating our policy against hate organizations, which policy we will never fully define or spell out, because it would allow hate organizations to adapt and evade our policy. Do not worry though, we know what it is and you can always ask us if you're in doubt. If we banned it, then it's a hate organization, and if we didn't, then it's not. Unless we made a mistake, in which case we apologize for any inconvenience.
- Dig1t 3y agoGood question. The Babylon Bee was a satirical news website, like The Onion, that was deplatformed (censored) from Twitter for making a joke about a trans person. Hate is often defined on these platforms as speech that can cause offense to some people.
- stirfish 3y agoBabylon Bee received a 12 hour suspension for calling a woman a man. There wasn't even really a joke attached, they were just being mean. It's not relevant to this paper.
- catiopatio 3y agoThey received an indefinite suspension until and unless they agreed to remove their post. There was a joke attached, not that this is at all relevant — they were using humor to highlight the absurd.
- youreincorrect 3y agoWatch the scientism-believers come out of the woodwork to accuse you of asking this in bad faith. It is, of course, largely the same group of people who will redefine "hate" organization to include people who, for example, didn't want to get vaccinated against COVID-19 [1][2][3]. They know that "hate" can be redefined in any manner as they wish, and if they can correlate hate <=> censorship is beneficial, and they can correlate anything-I-don't-like <=> hate, then they can correlate anthing-I-don't-like <=> censorship is beneficial. But they want to pretend you're the "sea lion" in some moronic comic as an ironic shorthand to disrupt and short-circuit a serious conversation on censorship. 1: https://theconversation.com/the-inherent-racism-of-anti-vaxx-movements-163456 https://theconversation.com/the-inherent-racism-of-anti-vaxx... 2: https://www.rollingstone.com/music/music-features/eric-clapton-vaccine-lockdown-racist-comments-1239027/ https://www.rollingstone.com/music/music-features/eric-clapt... 3: https://www.theedgemedia.org/purebloods-anti-semitism-white-supremacy-anti-vax/ https://www.theedgemedia.org/purebloods-anti-semitism-white-...
- tenebrisalietum 3y agoLet's try this definition: Group X is a hate organization if it explicity or implicity advocates, promotes, supports, or works toward the destruction of another group Y, with one or more of the following being true: - the reasons for the destruction are based on criteria that Y was born with and cannot change, - the reasons for the destruction are based on unproven, unprovable, or false claims, by X, targeting Y, that Y will destroy X. X may claim Y will destroy X through Y's very existence, through specific or vague planned action, or through attempts to rally, proselytize, or persuade. Claims may be but not limited to being scientific, economic or religious in nature. - group X believes it is receiving a mandate to commit the same to Y, due to an unproven, unprovable, or false claim that it has received a mandate, or one or more risen ringleaders in X have issued such a mandate based on a similar unproven, unprovable, or false claim. and often: - Ringleaders of X may be leveraging/exploiting/extorting one, some, or all of the following aspects of group members: emotions, faith, economic status, state of happiness, or threshold of accepting something as true without personally witnessing. The purpose of the manipulation is to align members of X towards action. Propaganda-like techniques may be employed.
- smsm42 3y agoGroup that hates immigrants because they take our jobs fails your criteria. So does anti-muslim group that does not allege Muslims are about to destroy them via planned action. The police enforcing, say, marijuana prohibition, seeking to destroy marijuana use culture, fits several.
- logicalmonster 3y agoPutting aside obvious questions such as "what is hate?", "who defines hate?", "what if something is falsely labelled as hate?", and "is preventing free speech ever ethical?", this study looks like a textbook example of the McNamara Fallacy in action. It's easy to ban a bunch of people and come up with an estimate of a large amount of hate reduced. "These hate-mongers posted X times per day to an audience of Y people, therefore we stopped Z hatred-incidents per month. Big progress in stopping hate.". That's the stupid man's interpretation of the available data. It's a lot harder to measure things like the feeling that people who already feel disenfranchised about life feel when they can't even vent about stuff on the Internet and what that leads to. The people with the ban-hammers are doing nothing but creating further and further resentment and confirming whatever biases and conspiracy theories that many people already feel.
- jackmott42 3y ago>The people with the ban-hammers are doing nothing but creating further and further resentment and confirming whatever biases and conspiracy theories that many people already feel. You had just got done critiquing the article in a clear and cogent way, then you go off and assert something for which you have no evidence. The existence of these online groups, they get people, they turn good people into bad people. We have friends and family we have seen it happen to. So perhaps they are not ONLY causing resentment among those already converted, but perhaps also preventing further conversion.
- logicalmonster 3y ago> You had just got done critiquing the article in a clear and cogent way, then you go off and assert something for which you have no evidence. You don't necessarily need, nor does one necessarily exist, a scientific study or formal citation for something fairly subjective/opinionated that you can give a justifiable explanation for. If somebody is blaming some group, say the French, for controlling everything from the media, taxis, the money supply, politics, pharmaceuticals, real-estate, Hollywood, the Fast Food Industry, and Silicon Valley and suddenly get removed from all of polite society, it doesn't take a peer-reviewed scientific study to suspect that they're likely going to be having even darker thoughts about the French and feeling that this confirms their theories that the Frenchies are out to get them. > The existence of these online groups, they get people, they turn good people into bad people. We have friends and family we have seen it happen to. So perhaps they are not ONLY causing resentment among those already converted, but perhaps also preventing further conversion. 1) You just got done critiquing me for trying to assert something with no evidence, but then did quite a bit of that here. Should I demand a citation and scientific study for every opinion here? 2) You use the phrase "bad people", and maybe many of them are, but there's a wide range of views out there that are labelled hate that might not be so.
- jWhick 3y agoI would be curious in research involving removal of online hate speech and how it correlates to in person violence, mental outbreaks and similar stuff.
- stirfish 3y agoThere's a bunch in the references in this paper, and an entire "Terrorism and social media" wikipedia page. Those are fine places to start.
- Veen 3y agoI'm struggling to find specifics in the paper and its appendices about which hate organizations and individuals were deplatformed. I understand that there are privacy concerns, but it's hard to take this entirely seriously without knowing the underlying incidents. I'm sure the researchers are sincere, but, given the recent history of the social sciences, I find myself skeptical.
- krapp 3y agoIt's weird how any mention of "hate" or "hate speech" or "hate groups" in an article immediately causes Hacker News to segfault and the first comment is always asking for a definition of the word. And yet, in every argument defending hate speech under the principle of absolute free speech, or denouncing "the left" or "the wokes" or whatever the bugbear of the moment is, they seem to know exactly what hate means and how to apply it. Anyway, since no one is going to bother reading TFA and this thread is probably going to be thoroughly derailed and flagged, the effect seems to be that deplatforming works: We study the effects of six network disruptions of designated and banned hate-based organizations on Facebook, in which known members of the organizations were removed from the platform, by examining the online engagements of the audience of the organization. We show that on average, the network disruptions reduced the consumption and production of hateful content, along with engagement within the network among audience members. The results suggest that strategies of targeted removals, such as leadership removal and network degradation efforts, can reduce the ability of hate organizations to successfully operate online.
- commandlinefan 3y ago"Censoring people reduces their ability to communicate" is a "water is wet" finding, though. Of course the discussion turns to "when is this actually ok" because we've seen it abused over and over and over again (and only questionably ever used legitimately).
- youreincorrect 3y agoExactly. And, furthermore, the finding is akin to a form of survivorship bias. 'We found they stopped talking to each other and promoting hate online.' Okay, and what did they do next? Did they just stop hating people? Did they figure out a way to start meeting in person without Facebook to mediate the conversation? Did some of them become increasingly isolated that they decided to act out? Did some people who weren't members of the hate group happen to see this form of censorship and start to change their own minds? I'm not saying any of these outcomes are what happened or are inevitable, I'm wondering how they can call this real science when they don't even bother looking at the other effects outside of their water-is-wet conclusion.
- Dig1t 3y agoLooks like they figured out that censorship is effective. Which is why so many people are upset at the level of censorship happening online.
- jackmott42 3y agoI'm sorry you don't have enough places to talk to bigoted people online, have you tried TOR?
- motohagiography 3y agoAs an example, this idea that being awful when you use the favoured epithets instead of the disfavoured ones is somehow acceptable in public is the deeper problem.
- commandlinefan 3y ago> bigoted Reddit permanently banned my account for _upvoting_ covid vaccine hesitancy (which is turning out to be accurate).
- Dig1t 3y agoThat's insane, I had no idea that Reddit had gone that far. It's pretty crazy that just registering agreement with an idea is enough to be censored. It's like wrongthink from 1984.
- wongarsu 3y agoA specific flavor of censorship, where you identify and ban the most important members, leaving the community to slowly die. A well known technique, probably adapted from methods used in intelligence circles, that's much more successful than banning the community outright.
- pickingdinner 3y agoHate groups are the problem, not how they express themselves online. I find it odd that it's perfectly legal to be a group with illegal intent. That's the only loophole that needs to be closed. If a group is deemed to have "intent to harm and endanger others" then anyone who affiliates themselves with them should be deemed likewise, and attended to. So the issue is of pre-crime. A crime has to happen and speech isn't a crime (although censorship should be, we censor them instead). But if members of a group have already committed crimes and crimes of hate, then that should be enough to legally impose restrictions on the group and its members, including those that haven't. Maybe not arrest them immediately, but monitoring etc should be perfectly legal (and maybe done already). All any member has to do is unaffiliate themselves to free themselves from being high risk and attended to by law enforcers.
- dingnuts 3y ago> if members of a group have already committed crimes > then that should be enough to legally impose restrictions on the group and its members This is called "keeping a public nuisance" and it's illegal in many jurisdictions. It's not limited to hate crimes. These conversations about online hate groups would be more productive if people knew what the law was to begin with.
- pickingdinner 3y agook so you and cryptonector below are in disagreemeng. Also I am not claiming I know any laws. I am claiming the law needs to be adjusted, not censorship standards.
- deleted 3y ago[deleted]
- cryptonector 3y agoA group intent on committing crimes commits conspiracy, and that is already a crime in most of the U.S.
- dotandgtfo 3y agoControversial stuff in this day and age but these kind of interventions on large scale social media networks are positive in my mind. I'll share some thoughts and counter arguments Keep in mind I'm European, and not American. I think we have a different view on this. Especially e.g. countries with a coloured history of hate speech like Germany. 1. Ideas need to be open so they can be challenged: These platforms don't create discussions, they create echo chambers. Nobody of their right mind engages with the crazies online as it's obviously a waste of time. Try to go to Facebook and debate with any of their "Flat earth" groups. It's absolutely futile. These "debates" are better for recruiting new people into hateful ideology than building understanding. 2. "Free speech" something or another: There is no such thing as "free speech" because there are already limits to speech. We've already drawn an arbitrary line on what's legal and harassment, death threats, racism, discrimination, defamation and multitudes of other types of speech are already controlled. If something is illegal to say to someones face, why should it be legal to say online? Not to mention that discussions about free speech spans borders and laws are different across them. 3. Who defines what's hate speech? I'm not an American, but I am at the mercy of your platforms. I for one would much rather that at EU-based body, or my government (I know this sounds crazy for an American, but we have more trust in our institutions) decides what's OK to say rather than tech billionaires like Elon Musk, Mark Zuckerberg, or Sundar Pichai. These people are already making moderation decisions, which is inevitable with large-scale social media. Make these policy decisions openly. Make them democratically. Large scale social media platforms are cesspools already. Unmoderated social platforms turn into cesspools by default. Moderation of these platforms must be moved out of private companies and into the public sphere so we as a society can agree on what is right, and what is wrong.
- shapenamer 3y agoI'm not European but I find it incredibly bizarre that you would prefer such a thing. The worst Elon Musk can do to you is kick you off his platform. As soon as a government gets involved you're looking at being potentially locked in a cage like an animal for expressing your opinion. They say the people get the government they deserve though.
- 3y ago
- waboremo 3y agoNo real surprises here; once you remove the source, the moths stop flying towards it. I reckon for most; their hate is based on emotional manipulation over an internal drive. This is what separates their "leaders" who are doing it for a specific end result, and their "followers" who are reacting to whatever comes across their feeds. Which is how they leverage this, it's easy to emotionally manipulate those who have no idea what's going on, they don't even recognize the ads/recommendations they're getting have served a specific purpose.
- Pyramus 3y agoSo HN users, who disagree about research into the effectiveness of deplatforming, resort to HN's version of 'deplatforming'?
- jadamson 3y agoNot sure anyone disagrees that it's effective, especially not if you only examine behaviour localized to one platform. Anyone who doesn't like this submission being flagged can always start an offsite dedicated to advocating for even more extreme censorship.
- ThrowawayTestr 3y agoDespite being flagged, I can still see the link and we can still comment on it. It's not memory-holed.
- ryandrake 3y agoGiven the first few comments were disingenuous questions about what the definition of "hate" is, there was no doubt that this one would be flagged to oblivion. My kid knew the meaning of the word "hate" at 4 years old. HN users don't?
- waboremo 3y agoExactly, it's always the loaded questions they start with to control the narrative.
- deleted 3y ago[deleted]
- Battleloser 3y agoJannys are a plague