8 ms·

There are 3 options for moderation: 1. Platforms with no moderation (8Chan -- except probably even worse, because even 8Chan moderates some content) 2. Publis

There are 3 options for moderation: 1. Platforms with no moderation (8Chan -- except probably even worse, because even 8Chan moderates some content) 2. Publishers that pre-vet all posted content (the NYT with no comment section) 3. Platforms that retroactively moderate content only after it's been posted, in whatever way they see fit (Twitter, Facebook, Twitch, Youtube, Reddit, Hackernews, and every public forum, IRC channel, and bug tracker ever built) Revoking section 230 just gets rid of option 3. It's not magic, it just means that we have one less moderation strategy. And option 3 is my favorite. Option 2 takes voices away from the powerless and would be a major step backwards for freedom of expression. It would entrench powerful, traditional media companies and allow them greater control over public narratives and public conversations. Option 1 effectively forces anyone who doesn't want to live on 8Chan off of the Internet. Moderation is a requirement for any online community to remain stable and healthy. Even taking the premise that Twitter is an existential threat to democracy (which I am at least mildly skeptical of), it's still mind-boggling to me that people are debating how to regulate giant Internet companies instead of implementing the sensible fix, which is just to break those companies up and increase competition. All of the "they control the media and shape public opinion" arguments people are making about Facebook/Twitter boil down to the fact that ~5 companies have become so large that getting kicked off of their services can be at least somewhat reasonably argued to have an effect on speech. None of this would be a problem if the companies weren't big enough to control so much of the discourse. So we could get rid of section 230 and implement a complicated solution that will have negative knock-on effects and unintended consequences for the entire Internet. Or, we could enforce and expand the antitrust laws that are already on the books and break up 5 companies, with almost no risk to the rest of the Internet. What problem does revoking section 230 solve that antitrust law doesn't?

anfilt 7y ago
I think your missing an option that is kinda similar category of 1. The platform only removes illegal content, but moderation is not done by the provider at all. Instead users moderate the content themselves. Think of how search engines can apply safe search filters going from safe, moderate, and off. So let users mark content with tags/categories, or some kind of rating. Then users can had posts that have or don't have certain content tags or a rating below x ect... Also you have platforms like discord that lets users create areas dedicated to a topic and self moderate.
- danShumway 7y ago
  > Instead users moderate the content themselves. I like putting users in control of moderation and giving communities the power to self-determine what content they see. This is one of the premises behind the fediverse. However, I think that's just option 3. If we accept that users have a right to filter content, then users should also have the right to use automated tools to filter content. If users make a block-list, they should have the right to share that block-list with other people. By extension, they should also have the right to delegate that filtering to another entity, like a forum moderator. They should be able to pay that entity money to maintain a block list for them. And jumping off of the Discord example, if users have the right to collectively ban people from a community, they should also have the right to automate that process, to share ban-lists, and to grant moderators the ability to ban people on their behalf. I don't see a _fundamental_ difference between Reddit banning someone and a single subreddit moderator banning someone. It's just a question of scale. To circle that back to the antitrust question: I regularly see comments about revoking section 230 that say, "well, this would only apply to large companies." It seems that in general, most people are fine with small communities moderating themselves and banning bad actors, even if the criteria is arbitrary. It only becomes a problem for them when Facebook does it because Facebook is big. We could go to Facebook and say, "you're too big, so you can't moderate on behalf of your users." Or, we could go to Facebook and say, "you're too big, we're breaking you up and making smaller communities." It seems to me that the second option is a lot simpler.
  - nradov 7y ago
    Should communities have the right to collectively ban users for being Jewish, or female, or Marxist, or older than 40?
    - danShumway 7y ago
      Do you want a value answer or legal one? The legal answer is that we have narrow exceptions to freedom of association around businesses (and a few other places) refusing service and closing doors to very specific protected classifications. Arguably they should be a little less narrow, but that's straying into a values answer. Of the attributes you list, race and gender are pretty strong protected categories. Age to a lesser degree. Marxism is a political category, there is no law that says Twitter couldn't ban someone for being Marxist. These are very narrow categories, and for most part anything outside of them is fair game. --- From a values perspective, I think our current system is pretty good. We don't restrict the ability to ban users except in very specific cases for very specific protected categories. Those categories are narrowly defined, based on strong needs that communities have for protection. We can expand those protections of course, but the fact that we have very narrow exceptions to users' Right to Filter[0] in narrow situations does not mean that we should ditch the entire thing. Just because your content is technically legal does not mean you have a right to force me to consume it. In other words, I'm quite sympathetic to the argument that our protected categories should be broader in some instances. I'm not sympathetic to the argument that because protected categories exist, a forum shouldn't be able to ban Republicans or Democrats. If you want to take away a community's Right to Filter on an attribute, I believe you should be required to demonstrate an extremely clear, compelling need to protect that specific attribute. And in particular, I don't see any reason at all to expand those protections to political categories. ---- While we're on the subject of laws, it's always important to remind people that in the US, hate speech is protected speech -- and that's probably not going to change any time in the near future. The Supreme Court has been remarkably consistent on this point for a pretty long time. This has implications for what revoking section 230 means. Before section 230, the Supreme Court ruled that platforms that had no knowledge of the content on their site -- that were not moderating it in any way -- couldn't be constitutionally held liable for speech on their platform[1]. Absent 230, if Facebook wants to call itself a platform, it needs to fall back on that ruling. So if they see someone harassing you for being Jewish, or female, or Marxist, or older than 40, Facebook won't be able to ban that person. Engaging in any moderation will make them liable for all of the content posted on their site. And no company-run corporate platform is going to risk personal liability for all of their content just to ban nazis. Given that reality, I don't think any progressive should be arguing for the removal of section 230. Using a legal standard for moderation will make the Internet way more toxic for underrepresented groups than it already is today. I have heard people (usually non-progressives) make the argument that this is fine, because if no one is banned from any community, everyone can participate. In other words, let the trolls run wild. I don't have much respect for that argument. If you allow every open forum to become toxic, only toxic people will be able to stomach them. Safe spaces foster diversity, and there is no way to build a safe space for user-generated content without moderation. If you don't believe me, then go join 8Chan and have fun, I guess. I know a few progressives are hoping that the user-generated content will go away entirely, and that Jewish/female/Marxist/middle-aged people will just participate on traditional channels. I think this is also kind of naive. No one who's seriously looked at the history of traditional media channels would come away thinking they've been bastions of the progressive movement. Marginalized voices have been excluded from those channels again and again, and it's only by fighting, by circumvention, and by self-publishing their own stories and building their own collectives and communities that those marginalized voices have been able to make themselves heard. ---- [0]: https://anewdigitalmanifesto.com/#right-to-filter https://anewdigitalmanifesto.com/#right-to-filter [1]: https://en.wikipedia.org/wiki/Section_230_of_the_Communications_Decency_Act#History https://en.wikipedia.org/wiki/Section_230_of_the_Communicati...
slg 7y ago
I would generally agree with everything you said here except that Option 1 is really just Option 3 except the "way they see fit" is very minimal. Moderation still exists on those "unmoderated" sites. No right-minded person supports completely unmoderated content like no right-minded person supports completely unregulated free speech. Child porn is the most obvious example of an exception to both. We can all agree that we don't want to see that and don't want to host it on our platforms. Once you accept that, it basically becomes a question of negotiating where that line is. It is reminiscent of that old inappropriate Churchill joke about haggling over price [1]. [1] - https://www.goodreads.com/quotes/300099-churchill-madam-would-you-sleep-with-me-for-five-million https://www.goodreads.com/quotes/300099-churchill-madam-woul...
- SkyBelow 7y ago
  I think a difference of kinds and not just degrees can be established between moderating just illegal content. But maybe not, given that there is a lot of different interpretations of what is illegal and judgment calls have to be made over that, as well as issues of jurisdiction and even issues involving laws that may be unconstitutional.
  - yifanl 7y ago
    Neither what's illegal and what's immoral are static (though I concede that it is often slower to change laws than public perception)
  - mirimir 7y ago
    Yes. The problem is that, once the ability exists to nuke whatever you consider to be illegal, someone else will use it to nuke stuff that you like. If every country could impose its standards on the Internet, there'd be no Internet. It's only worked so far because the US has strong free speech rights, and has dominated.
    - johnisgood 7y ago
      And at the same time my ISP cares less and censors less here in Eastern Europe... :P You will most likely not get a letter for downloading movies, games, and so forth.
ep103 7y ago
I do not think that the companies that have the funding and technical ability to effectively astroturf facebook/twitter et al, would be rendered even mildly impotent were there 3x as many social media companies as there are now. Its a systemic failure on the way these companies act, not just a lack of competition. When facebook is showing friends and family that I made a comment, they fit fairly within the scope of a neutral carrier, akin to a phone call or text message. When facebook republishes a NY Times post or headline, on the official NYTimes facebook page, they are acting as a republisher, and so be it. Any user will associate the story with the NY Times. But when facebook publishes my post and headline, on the official "MY Times" facebook page, they are taking my content, and publishing it, as a publisher. And they are doing so, in a manner that intentionally gives me the same appearance of gravitas as the NY Times. When Facebook then decides to show my post instead of the NY Times post to other people in their feed, they are then curating and distributing this novel content. That is to say, they are publishing this content, as a publisher. Your 3 options fail to differentiate between this nuanced but important difference. Facebook should not be required to police the content between individuals posting as individuals. And Facebook should not be held responsible for redirecting traffic to established publishers and content providers. But claiming that individuals, who are unable to publish without Facebook's platform, are also publishers, and therefore Facebook is not liable for their content, despite Facebook's actions to then selectively curate, distribute, and, in a word, publish their novel content, is not the spirit of 230.
- bearcobra 7y ago
  The distinction about how sites like YouTube and Facebook amplify content is important. But moving away from the digital version, it would seem strange to me if Barnes and Noble became liable for having a big display for a book that defamed someone. INAL so maybe they would be, but as a thought experiment I lean towards them having significantly less responsibility than the author.
  - ep103 7y ago
    Facebook is not acting like Barnes and Nobles displaying a book. The closer analogy would be if, by becoming a B&N member, you were allowed to submit manuscripts to B&N. B&N then curated a small selection of those manuscripts to display in a format identical to the other books they sell, prominently in the front of their store. They then began advertising for those specific titles to bring traffic specifically to that store display. That's what facebook is doing. That's publishing.
ocdtrekkie 7y ago
The problem with this opinion is that you forget what powers these platforms: Money. Section 230 allows platforms to profit off illegal and harmful content with no responsibility whatsoever. When Facebook promotes falsehoods, they profit. When Google sells links to malware and scam sites at the top of search, they profit. And even if they get around to moderating these abuses of their platforms, they keep the profit from the harm done via their platforms. If we want platforms to have the proper incentives to moderate content properly, they need to lose money when they fail, or at least, fail to profit when they fail. Ad money for malware campaigns and scams should be confiscated. But right now, malicious actors on ad platforms drive up the revenue on bidding-based platforms, and no matter who wins the bid, that equals money for ad companies. They have fundamentally no incentive to police content that's making them money.
- d1zzy 7y ago
  > The problem with this opinion is that you forget what powers these platforms: Money. Section 230 allows platforms to profit off illegal and harmful content with no responsibility whatsoever. That's phrasing it in a way that makes it misleadingly clear who's in the wrong: of course all good people will not want something like that to happen. The devil is in the details. How much does that "illegal and harmful" content help their bottom line? Is it making 50% of their income? 10%? 1% or less? After knowing the percentage value can you still make a general statement like "companies are profiting on illegal and harmful content"? Or the more correct statement would be "companies make extremely little profit on illegal and harmful content"? On the other hand, before proposing mandatory moderation for all user content on all platforms we have to ask more questions. How much would it cost if all content is moderated in order to catch that X% that is "illegal and harmful"? Everything has a price.
  - ocdtrekkie 7y ago
    > How much does that "illegal and harmful" content help their bottom line? Is it making 50% of their income? 10%? 1% or less? The problem is that nobody actually has that data (and they'll claim your point is invalid unless you have the data, which only they even have the potential to gather). Google and Facebook will tell you it's very low, but since they're ignoring reports of malicious apps on their platforms and restoring scammy ad campaigns after they've been reported and taken down internally, what they consider bad content is likely much smaller than reality. Honestly, with both the amount of flagrantly malicious content I see on Google and Facebook ad platforms, and the network effects that their participation has on bidding for placement, I would suspect that these companies are nearly dependent on malicious content for profitability. Another huge point is that a lot of legitimate advertisers are paying just to protect their brand from having scams placed above their own site in searches for their trademark. This is pretty close to an extortion racket. I think there’s a Big Short level event on the horizon where we discover some of the top valued companies on the planet are built on a lot more of this than they’ve let on.
tboyd47 7y ago
The analysis you present is very misleading. The CDA doesn't say anything about retroactive moderation or pre-vetting, but grants legal immunity with no regard for moderation styles. So how do you get from here to there? > So we could get rid of section 230 and implement a complicated solution that will have negative knock-on effects and unintended consequences for the entire Internet. The antitrust route seems much more complicated to me because prosecutors would have to bring a new case to court for every major company, at taxpayers' expense. What's complicated about repealing a 2-clause law? Is there another part to this process I'm not aware of? > What problem does revoking section 230 solve that antitrust law doesn't? Aside from being much simpler and less expensive to taxpayers? It would solve the problem once and for all by removing the source of the problem, instead of forcing the government to handle it one company at a time.
- danShumway 7y ago
  > What's complicated about repealing a 2-clause law? There's substantial consensus among Internet scholars that this would change the entire Internet ecosystem in either negative or at least highly unpredictable ways. It's complicated because we need to consider and plan for the consequences, and because it opens up an entire new set of legal distinctions that have never been applied to the Internet and will need to be established and refined over decades. Repealing 230 is simple in the same way that SESTA/FOSTA was simple -- there are lots of things that seem simple until you consider the details. On the other hand, antitrust law is pretty widely established, it's something we need to be applying across the entire market (both online and offline) anyway, and breaking up companies has comparatively fewer fundamental consequences for the wider. It's a mistake to measure complexity in lines of law, in the same way that it's a mistake to measure program complexity in lines of code. The real test is, "how much of the system does this change, how invasive is it, and do we know what all of the effects will be?"
  - tboyd47 7y ago
    The details and complications aren't the general taxpayer's problem, though. It's Google & Facebook's problem. We don't take any of the profits they made off of Section 230 -- why should we have to pay to clean it up? > It's a mistake to measure complexity in lines of law, in the same way that it's a mistake to measure program complexity in lines of code. Removing code that's outdated is usually a step in the right direction. And when you fix a bug, you always want to fix it at the source of the problem.
ericmcer 7y ago
What role do you think anonymity plays in this discussion? Communities would self police much better if some level of anonymity was removed from members; its less likely that “John Davidson” would post a racist rant than “xxTrump2020xx”. Removing some anonymity also comes with a huge slew of issues, but it would definitely resolve a lot of content problems if there was a real world link to online behavior.
- danShumway 7y ago
  > Communities would self police much better if some level of anonymity was removed from members This isn't an illogical theory, but I think Facebook's real-name policy disproves it. We could have a deeper conversation about whether or not anonymity is more important than civility (I think it is). But I think before having that conversation I would want to be convinced that anonymity significantly impacts civility, and I'm much more skeptical of that claim today than I used to be. I tend to suspect now that it's more of a "common-sense" theory than something backed up by real-world studies.
- godshatter 7y ago
  That makes intuitive sense, but hasn't matched what I've seen in real life. I have had much more interesting and polite conversations on Freenet (which provides almost complete anonymity) than I have had on Facebook, back when I used it. I'm guessing it's because the audience is smaller and less visible. I think people posture for the invisible audience they assume are watching their every post, so larger communities tend to go south much more quickly than smaller more focused ones. You also get more group-think and mob-like behavior. As another example, smaller subreddits on reddit are much more polite and fun (in my experience) than the main subs. Whenever a subreddit I'm on gets linked to r/all, I just skip that post for my general mental stability. Youtube comments are another example, which are generally terrible in my experience and are visible by a huge potential audience.
- heavyset_go 7y ago
  > Communities would self police much better if some level of anonymity was removed from members; its less likely that “John Davidson” would post a racist rant than “xxTrump2020xx”. A lot of Facebook users have no problem writing racist rants using their real names.
bobthepanda 7y ago
I think a much better solution would be to revoke Section 230 for "recommended" content. "Recommendations", even algorithmically generated ones, are behind a lot of the brouhaha, and by endorsing content that's basically being a publisher of content anyways.
mirimir 7y ago
> Option 1 effectively forces anyone who doesn't want to live on 8Chan off of the Internet. If you have adequate filters, you don't need to see anything that you don't like. I do agree on the antitrust point.
- schoen 7y ago
  Has anybody found a good model for scaling display filtering that respects users' priorities and sensibilities, rather than platform owners' and governments'? One thing I keep hearing is that doing moderation that gives users an experience they like is a ton of work, is very experience, and can be hard on the moderators' mental health if they do it a lot and the user base is large enough. (For example, some of the moderators might be watching videos of real people dying or getting raped all day long.) In Mastodon and so on there are instance administrators, typically volunteers, but they don't scale well and probably don't deal well with large variations in people's beliefs, culture, and interests, nor with overlapping group memberships. Meanwhile, major platforms are spending millions of dollars paying people to do moderation as a full-time job, in a heavy-handed, error-prone, arbitrary and centralized way where the only options are sometimes "delete this for everyone", "ban the user", or "allow this for everyone". (The "sophisticated" systems may also allow things like "hide this behind a sensitive content button", "hide this from users who don't claim to be over 18", and "ban this in certain countries".) More sophisticated, nuanced, and pro-speech filtering work that doesn't aim to uphold a single worldwide standard seems like it will be even more expensive; who will do it and how will we incentivize it?
  - mirimir 7y ago
    Huh, I was going to reply here, but then I replied there: https://news.ycombinator.com/item?id=22380069 https://news.ycombinator.com/item?id=22380069 Here seemed too hard, I guess. But ... > More sophisticated, nuanced, and pro-speech filtering work that doesn't aim to uphold a single worldwide standard seems like it will be even more expensive; who will do it and how will we incentivize it? That's certainly what I'd want. The standard federated model of shared filtering rules being applied at the node level is way too prone to generating filter bubbles. Also, people who are genuinely open-minded and interested in free discussion would never put up with it, and they're the most fun to be around. That's why I've never gotten into Mastodon. I'd want filtering rules that participants applied locally. The model used by ad-blocking browser extensions, Pi-hole and such would arguably work. But of course, sets of rules would be far more complex, and it'd be best to hide them under a simple user interface. Let's say that someone open-sourced the sort of moderation repo that major platforms are developing. With adjustable automated pre-filtering, and human tweaking. So then any participant could run that, and publish their rules. Other participants, maybe mega nodes who got paid for their efforts, would consolidate all those rules into coherent sets, and then publish those. There'd be multiple such services, and they'd compete on filter type and quality. > For example, some of the moderators might be watching videos of real people dying or getting raped all day long. That is a problem. I know that personally. For many years, I relied on hearsay about Freenet, because I was way too paranoid to actually run it locally. But eventually, I developed the skills to run it on a remote server, with adequate anonymity. So I did. I won't go into detail. But let's just say that I can not imagine how any decent person could moderate some of that stuff without mental damage. So as distasteful as it might be, perhaps the system could incorporate filter rules from people who enjoy that stuff. They'd be motivated to adequately anonymize their contributions, of course. And if they succeeded, there'd be no leverage for anyone to be forced to identify them. And if they were careless, that would be great. Once their rules had been characterized, however, they'd be reversed before integration with everyone else's. And the same methodology could be used for all other widely distasteful categories of content.
deleted 7y ago
[deleted]
nvahalik 7y ago
Isn't technically the internet, as a whole, operating as #1 (at least, in theory?). If I want to post material that is sketchy, or even illegal, I can typically get away with posting it somewhere. It means that I have to host the content but it also means I have total control. So in a way, revoking section 230 would inevitably break up the big sites by forcing people who are interested in posting/hosting content that others disagree with on their own. While this would have some economic impact (just like demonitization), it might also mean that the amount of content might go down because people would have to defend themselves and their use of said content. In a way, I'm a bit torn about this because revoking section 230 would seem like it comes about it from a different angle: removing the protection would allow the "free market" to respond whereas the other option would be the government "forcing" the breakup.
- manfredo 7y ago
  Revoking 230 would disrupt big sites, but would likely further cement their monopoly. Liability for user generated content means that sites that feature user generated content need to spend a lot of resources on moderation, because the consequences of a false negative are large. People who talk about section 230 breaking up large companies seem to be harboring the assumption that section 230 will only apply to large companies. This is not the case. It will be a massive blow to any site that features user generated content. A blow that only large sites have the resources to withstand.
  - Techies4Trump 7y ago
    I think if this happens, decentralized social networks will really take off. The "small sites" you refer to , which I'm assuming are typical forum type sites, have been dying a slow death for the past few years anyway, since FB ate their lunch.
    - manfredo 7y ago
      Small sites would be absolutely devastated because the threat of being held liable for user comments will be way too large of a risk. Small networks don't have the resources to pre-moderate comments or build sophisticated automated systems of identifying high risk content. How many people would host their own site when the consequences of user-submitted illegal content being posted could mean millions in liability? Very few, if any. The result is that large players are the only ones that can survive in a market where companies are held liable for user submitted content. Maybe if by "small" you're talking about dozens of people. But I fail to see how comparably small sites like Hacker News could continue to exist without section 230 protections. It'd probably take fundamental changes like charging users a subscription in order to pay for enough moderators to pre-moderate comments and submissions and I am unsure if that's even a viable approach.
heavyset_go 7y ago
Revoking Section 230 would make option 1 unviable, too, as liability for user content is waived by that particular section of the CDA. Without Section 230, all interactive computer services are liable for content they host and serve to others, even if they choose not to moderate it.
mr_toad 7y ago
Congress would backtrack in a hurry as soon as it affected their campaign platforms.
krilly 7y ago
It's worth mentioning that nearly every board on 8chan IS moderated, by the board owners. Its exactly the same as the Reddit model, paid admins only enforce the few site wide rules and board owners are left to moderate their boards however they see fit. That might be heavy or light moderation, but if people are upset with the moderation style they just make another board.
RestlessMind 7y ago
There is a 4th option - treat certain surfaces of social media companies, mainly the user specific pages (Donald Trump's twitter page, PewDiePie's YT channel etc) as a platform; treat other surfaces which are generated based on algorithms and not directly by individual users (FB feed, YT watch feed, reddit homepage etc) as a publisher. That way, social media companies won't be responsible for what their users upload. But they will be responsible for what they present to their users to optimize clicks / engagement / revenue etc.
zapita 7y ago
> What problem does revoking section 230 solve that antitrust law doesn't? From the point of view of AG Barr, whose objective is to weaponize the DOJ for the purpose of expanding Russian oligarch interests in the US, revoking section 230 is effective because it is laser-focused on tech companies. On the other hand, antitrust law affects all monopolists in all industries equally - and most of those monopolists are Barr's allies. He doesn't want to bite the hand that feeds him.
Canada 7y ago
I think there might be a 4th option for moderation: Local filtering like ad blockers. Perhaps if big centralized platforms came with stricter liability there might be an opening for more open/distributed protocols once again.

anfilt 7y ago

I think your missing an option that is kinda similar category of 1. The platform only removes illegal content, but moderation is not done by the provider at all. Instead users moderate the content themselves. Think of how search engines can apply safe search filters going from safe, moderate, and off. So let users mark content with tags/categories, or some kind of rating. Then users can had posts that have or don't have certain content tags or a rating below x ect... Also you have platforms like discord that lets users create areas dedicated to a topic and self moderate.

danShumway 7y ago
> Instead users moderate the content themselves. I like putting users in control of moderation and giving communities the power to self-determine what content they see. This is one of the premises behind the fediverse. However, I think that's just option 3. If we accept that users have a right to filter content, then users should also have the right to use automated tools to filter content. If users make a block-list, they should have the right to share that block-list with other people. By extension, they should also have the right to delegate that filtering to another entity, like a forum moderator. They should be able to pay that entity money to maintain a block list for them. And jumping off of the Discord example, if users have the right to collectively ban people from a community, they should also have the right to automate that process, to share ban-lists, and to grant moderators the ability to ban people on their behalf. I don't see a _fundamental_ difference between Reddit banning someone and a single subreddit moderator banning someone. It's just a question of scale. To circle that back to the antitrust question: I regularly see comments about revoking section 230 that say, "well, this would only apply to large companies." It seems that in general, most people are fine with small communities moderating themselves and banning bad actors, even if the criteria is arbitrary. It only becomes a problem for them when Facebook does it because Facebook is big. We could go to Facebook and say, "you're too big, so you can't moderate on behalf of your users." Or, we could go to Facebook and say, "you're too big, we're breaking you up and making smaller communities." It seems to me that the second option is a lot simpler.
- nradov 7y ago
  Should communities have the right to collectively ban users for being Jewish, or female, or Marxist, or older than 40?
  - danShumway 7y ago
    Do you want a value answer or legal one? The legal answer is that we have narrow exceptions to freedom of association around businesses (and a few other places) refusing service and closing doors to very specific protected classifications. Arguably they should be a little less narrow, but that's straying into a values answer. Of the attributes you list, race and gender are pretty strong protected categories. Age to a lesser degree. Marxism is a political category, there is no law that says Twitter couldn't ban someone for being Marxist. These are very narrow categories, and for most part anything outside of them is fair game. --- From a values perspective, I think our current system is pretty good. We don't restrict the ability to ban users except in very specific cases for very specific protected categories. Those categories are narrowly defined, based on strong needs that communities have for protection. We can expand those protections of course, but the fact that we have very narrow exceptions to users' Right to Filter[0] in narrow situations does not mean that we should ditch the entire thing. Just because your content is technically legal does not mean you have a right to force me to consume it. In other words, I'm quite sympathetic to the argument that our protected categories should be broader in some instances. I'm not sympathetic to the argument that because protected categories exist, a forum shouldn't be able to ban Republicans or Democrats. If you want to take away a community's Right to Filter on an attribute, I believe you should be required to demonstrate an extremely clear, compelling need to protect that specific attribute. And in particular, I don't see any reason at all to expand those protections to political categories. ---- While we're on the subject of laws, it's always important to remind people that in the US, hate speech is protected speech -- and that's probably not going to change any time in the near future. The Supreme Court has been remarkably consistent on this point for a pretty long time. This has implications for what revoking section 230 means. Before section 230, the Supreme Court ruled that platforms that had no knowledge of the content on their site -- that were not moderating it in any way -- couldn't be constitutionally held liable for speech on their platform[1]. Absent 230, if Facebook wants to call itself a platform, it needs to fall back on that ruling. So if they see someone harassing you for being Jewish, or female, or Marxist, or older than 40, Facebook won't be able to ban that person. Engaging in any moderation will make them liable for all of the content posted on their site. And no company-run corporate platform is going to risk personal liability for all of their content just to ban nazis. Given that reality, I don't think any progressive should be arguing for the removal of section 230. Using a legal standard for moderation will make the Internet way more toxic for underrepresented groups than it already is today. I have heard people (usually non-progressives) make the argument that this is fine, because if no one is banned from any community, everyone can participate. In other words, let the trolls run wild. I don't have much respect for that argument. If you allow every open forum to become toxic, only toxic people will be able to stomach them. Safe spaces foster diversity, and there is no way to build a safe space for user-generated content without moderation. If you don't believe me, then go join 8Chan and have fun, I guess. I know a few progressives are hoping that the user-generated content will go away entirely, and that Jewish/female/Marxist/middle-aged people will just participate on traditional channels. I think this is also kind of naive. No one who's seriously looked at the history of traditional media channels would come away thinking they've been bastions of the progressive movement. Marginalized voices have been excluded from those channels again and again, and it's only by fighting, by circumvention, and by self-publishing their own stories and building their own collectives and communities that those marginalized voices have been able to make themselves heard. ---- [0]: https://anewdigitalmanifesto.com/#right-to-filter https://anewdigitalmanifesto.com/#right-to-filter [1]: https://en.wikipedia.org/wiki/Section_230_of_the_Communications_Decency_Act#History https://en.wikipedia.org/wiki/Section_230_of_the_Communicati...

slg 7y ago

I would generally agree with everything you said here except that Option 1 is really just Option 3 except the "way they see fit" is very minimal. Moderation still exists on those "unmoderated" sites. No right-minded person supports completely unmoderated content like no right-minded person supports completely unregulated free speech. Child porn is the most obvious example of an exception to both. We can all agree that we don't want to see that and don't want to host it on our platforms. Once you accept that, it basically becomes a question of negotiating where that line is. It is reminiscent of that old inappropriate Churchill joke about haggling over price [1]. [1] - https://www.goodreads.com/quotes/300099-churchill-madam-would-you-sleep-with-me-for-five-million https://www.goodreads.com/quotes/300099-churchill-madam-woul...

SkyBelow 7y ago
I think a difference of kinds and not just degrees can be established between moderating just illegal content. But maybe not, given that there is a lot of different interpretations of what is illegal and judgment calls have to be made over that, as well as issues of jurisdiction and even issues involving laws that may be unconstitutional.
- yifanl 7y ago
  Neither what's illegal and what's immoral are static (though I concede that it is often slower to change laws than public perception)
- mirimir 7y ago
  Yes. The problem is that, once the ability exists to nuke whatever you consider to be illegal, someone else will use it to nuke stuff that you like. If every country could impose its standards on the Internet, there'd be no Internet. It's only worked so far because the US has strong free speech rights, and has dominated.
  - johnisgood 7y ago
    And at the same time my ISP cares less and censors less here in Eastern Europe... :P You will most likely not get a letter for downloading movies, games, and so forth.

ep103 7y ago

I do not think that the companies that have the funding and technical ability to effectively astroturf facebook/twitter et al, would be rendered even mildly impotent were there 3x as many social media companies as there are now. Its a systemic failure on the way these companies act, not just a lack of competition. When facebook is showing friends and family that I made a comment, they fit fairly within the scope of a neutral carrier, akin to a phone call or text message. When facebook republishes a NY Times post or headline, on the official NYTimes facebook page, they are acting as a republisher, and so be it. Any user will associate the story with the NY Times. But when facebook publishes my post and headline, on the official "MY Times" facebook page, they are taking my content, and publishing it, as a publisher. And they are doing so, in a manner that intentionally gives me the same appearance of gravitas as the NY Times. When Facebook then decides to show my post instead of the NY Times post to other people in their feed, they are then curating and distributing this novel content. That is to say, they are publishing this content, as a publisher. Your 3 options fail to differentiate between this nuanced but important difference. Facebook should not be required to police the content between individuals posting as individuals. And Facebook should not be held responsible for redirecting traffic to established publishers and content providers. But claiming that individuals, who are unable to publish without Facebook's platform, are also publishers, and therefore Facebook is not liable for their content, despite Facebook's actions to then selectively curate, distribute, and, in a word, publish their novel content, is not the spirit of 230.

bearcobra 7y ago
The distinction about how sites like YouTube and Facebook amplify content is important. But moving away from the digital version, it would seem strange to me if Barnes and Noble became liable for having a big display for a book that defamed someone. INAL so maybe they would be, but as a thought experiment I lean towards them having significantly less responsibility than the author.
- ep103 7y ago
  Facebook is not acting like Barnes and Nobles displaying a book. The closer analogy would be if, by becoming a B&N member, you were allowed to submit manuscripts to B&N. B&N then curated a small selection of those manuscripts to display in a format identical to the other books they sell, prominently in the front of their store. They then began advertising for those specific titles to bring traffic specifically to that store display. That's what facebook is doing. That's publishing.

ocdtrekkie 7y ago

The problem with this opinion is that you forget what powers these platforms: Money. Section 230 allows platforms to profit off illegal and harmful content with no responsibility whatsoever. When Facebook promotes falsehoods, they profit. When Google sells links to malware and scam sites at the top of search, they profit. And even if they get around to moderating these abuses of their platforms, they keep the profit from the harm done via their platforms. If we want platforms to have the proper incentives to moderate content properly, they need to lose money when they fail, or at least, fail to profit when they fail. Ad money for malware campaigns and scams should be confiscated. But right now, malicious actors on ad platforms drive up the revenue on bidding-based platforms, and no matter who wins the bid, that equals money for ad companies. They have fundamentally no incentive to police content that's making them money.

d1zzy 7y ago
> The problem with this opinion is that you forget what powers these platforms: Money. Section 230 allows platforms to profit off illegal and harmful content with no responsibility whatsoever. That's phrasing it in a way that makes it misleadingly clear who's in the wrong: of course all good people will not want something like that to happen. The devil is in the details. How much does that "illegal and harmful" content help their bottom line? Is it making 50% of their income? 10%? 1% or less? After knowing the percentage value can you still make a general statement like "companies are profiting on illegal and harmful content"? Or the more correct statement would be "companies make extremely little profit on illegal and harmful content"? On the other hand, before proposing mandatory moderation for all user content on all platforms we have to ask more questions. How much would it cost if all content is moderated in order to catch that X% that is "illegal and harmful"? Everything has a price.
- ocdtrekkie 7y ago
  > How much does that "illegal and harmful" content help their bottom line? Is it making 50% of their income? 10%? 1% or less? The problem is that nobody actually has that data (and they'll claim your point is invalid unless you have the data, which only they even have the potential to gather). Google and Facebook will tell you it's very low, but since they're ignoring reports of malicious apps on their platforms and restoring scammy ad campaigns after they've been reported and taken down internally, what they consider bad content is likely much smaller than reality. Honestly, with both the amount of flagrantly malicious content I see on Google and Facebook ad platforms, and the network effects that their participation has on bidding for placement, I would suspect that these companies are nearly dependent on malicious content for profitability. Another huge point is that a lot of legitimate advertisers are paying just to protect their brand from having scams placed above their own site in searches for their trademark. This is pretty close to an extortion racket. I think there’s a Big Short level event on the horizon where we discover some of the top valued companies on the planet are built on a lot more of this than they’ve let on.

tboyd47 7y ago

The analysis you present is very misleading. The CDA doesn't say anything about retroactive moderation or pre-vetting, but grants legal immunity with no regard for moderation styles. So how do you get from here to there? > So we could get rid of section 230 and implement a complicated solution that will have negative knock-on effects and unintended consequences for the entire Internet. The antitrust route seems much more complicated to me because prosecutors would have to bring a new case to court for every major company, at taxpayers' expense. What's complicated about repealing a 2-clause law? Is there another part to this process I'm not aware of? > What problem does revoking section 230 solve that antitrust law doesn't? Aside from being much simpler and less expensive to taxpayers? It would solve the problem once and for all by removing the source of the problem, instead of forcing the government to handle it one company at a time.

danShumway 7y ago
> What's complicated about repealing a 2-clause law? There's substantial consensus among Internet scholars that this would change the entire Internet ecosystem in either negative or at least highly unpredictable ways. It's complicated because we need to consider and plan for the consequences, and because it opens up an entire new set of legal distinctions that have never been applied to the Internet and will need to be established and refined over decades. Repealing 230 is simple in the same way that SESTA/FOSTA was simple -- there are lots of things that seem simple until you consider the details. On the other hand, antitrust law is pretty widely established, it's something we need to be applying across the entire market (both online and offline) anyway, and breaking up companies has comparatively fewer fundamental consequences for the wider. It's a mistake to measure complexity in lines of law, in the same way that it's a mistake to measure program complexity in lines of code. The real test is, "how much of the system does this change, how invasive is it, and do we know what all of the effects will be?"
- tboyd47 7y ago
  The details and complications aren't the general taxpayer's problem, though. It's Google & Facebook's problem. We don't take any of the profits they made off of Section 230 -- why should we have to pay to clean it up? > It's a mistake to measure complexity in lines of law, in the same way that it's a mistake to measure program complexity in lines of code. Removing code that's outdated is usually a step in the right direction. And when you fix a bug, you always want to fix it at the source of the problem.

ericmcer 7y ago

What role do you think anonymity plays in this discussion? Communities would self police much better if some level of anonymity was removed from members; its less likely that “John Davidson” would post a racist rant than “xxTrump2020xx”. Removing some anonymity also comes with a huge slew of issues, but it would definitely resolve a lot of content problems if there was a real world link to online behavior.

danShumway 7y ago
> Communities would self police much better if some level of anonymity was removed from members This isn't an illogical theory, but I think Facebook's real-name policy disproves it. We could have a deeper conversation about whether or not anonymity is more important than civility (I think it is). But I think before having that conversation I would want to be convinced that anonymity significantly impacts civility, and I'm much more skeptical of that claim today than I used to be. I tend to suspect now that it's more of a "common-sense" theory than something backed up by real-world studies.
godshatter 7y ago
That makes intuitive sense, but hasn't matched what I've seen in real life. I have had much more interesting and polite conversations on Freenet (which provides almost complete anonymity) than I have had on Facebook, back when I used it. I'm guessing it's because the audience is smaller and less visible. I think people posture for the invisible audience they assume are watching their every post, so larger communities tend to go south much more quickly than smaller more focused ones. You also get more group-think and mob-like behavior. As another example, smaller subreddits on reddit are much more polite and fun (in my experience) than the main subs. Whenever a subreddit I'm on gets linked to r/all, I just skip that post for my general mental stability. Youtube comments are another example, which are generally terrible in my experience and are visible by a huge potential audience.
heavyset_go 7y ago
> Communities would self police much better if some level of anonymity was removed from members; its less likely that “John Davidson” would post a racist rant than “xxTrump2020xx”. A lot of Facebook users have no problem writing racist rants using their real names.

bobthepanda 7y ago

I think a much better solution would be to revoke Section 230 for "recommended" content. "Recommendations", even algorithmically generated ones, are behind a lot of the brouhaha, and by endorsing content that's basically being a publisher of content anyways.

mirimir 7y ago

> Option 1 effectively forces anyone who doesn't want to live on 8Chan off of the Internet. If you have adequate filters, you don't need to see anything that you don't like. I do agree on the antitrust point.

schoen 7y ago
Has anybody found a good model for scaling display filtering that respects users' priorities and sensibilities, rather than platform owners' and governments'? One thing I keep hearing is that doing moderation that gives users an experience they like is a ton of work, is very experience, and can be hard on the moderators' mental health if they do it a lot and the user base is large enough. (For example, some of the moderators might be watching videos of real people dying or getting raped all day long.) In Mastodon and so on there are instance administrators, typically volunteers, but they don't scale well and probably don't deal well with large variations in people's beliefs, culture, and interests, nor with overlapping group memberships. Meanwhile, major platforms are spending millions of dollars paying people to do moderation as a full-time job, in a heavy-handed, error-prone, arbitrary and centralized way where the only options are sometimes "delete this for everyone", "ban the user", or "allow this for everyone". (The "sophisticated" systems may also allow things like "hide this behind a sensitive content button", "hide this from users who don't claim to be over 18", and "ban this in certain countries".) More sophisticated, nuanced, and pro-speech filtering work that doesn't aim to uphold a single worldwide standard seems like it will be even more expensive; who will do it and how will we incentivize it?
- mirimir 7y ago
  Huh, I was going to reply here, but then I replied there: https://news.ycombinator.com/item?id=22380069 https://news.ycombinator.com/item?id=22380069 Here seemed too hard, I guess. But ... > More sophisticated, nuanced, and pro-speech filtering work that doesn't aim to uphold a single worldwide standard seems like it will be even more expensive; who will do it and how will we incentivize it? That's certainly what I'd want. The standard federated model of shared filtering rules being applied at the node level is way too prone to generating filter bubbles. Also, people who are genuinely open-minded and interested in free discussion would never put up with it, and they're the most fun to be around. That's why I've never gotten into Mastodon. I'd want filtering rules that participants applied locally. The model used by ad-blocking browser extensions, Pi-hole and such would arguably work. But of course, sets of rules would be far more complex, and it'd be best to hide them under a simple user interface. Let's say that someone open-sourced the sort of moderation repo that major platforms are developing. With adjustable automated pre-filtering, and human tweaking. So then any participant could run that, and publish their rules. Other participants, maybe mega nodes who got paid for their efforts, would consolidate all those rules into coherent sets, and then publish those. There'd be multiple such services, and they'd compete on filter type and quality. > For example, some of the moderators might be watching videos of real people dying or getting raped all day long. That is a problem. I know that personally. For many years, I relied on hearsay about Freenet, because I was way too paranoid to actually run it locally. But eventually, I developed the skills to run it on a remote server, with adequate anonymity. So I did. I won't go into detail. But let's just say that I can not imagine how any decent person could moderate some of that stuff without mental damage. So as distasteful as it might be, perhaps the system could incorporate filter rules from people who enjoy that stuff. They'd be motivated to adequately anonymize their contributions, of course. And if they succeeded, there'd be no leverage for anyone to be forced to identify them. And if they were careless, that would be great. Once their rules had been characterized, however, they'd be reversed before integration with everyone else's. And the same methodology could be used for all other widely distasteful categories of content.

deleted 7y ago

[deleted]

nvahalik 7y ago

Isn't technically the internet, as a whole, operating as #1 (at least, in theory?). If I want to post material that is sketchy, or even illegal, I can typically get away with posting it somewhere. It means that I have to host the content but it also means I have total control. So in a way, revoking section 230 would inevitably break up the big sites by forcing people who are interested in posting/hosting content that others disagree with on their own. While this would have some economic impact (just like demonitization), it might also mean that the amount of content might go down because people would have to defend themselves and their use of said content. In a way, I'm a bit torn about this because revoking section 230 would seem like it comes about it from a different angle: removing the protection would allow the "free market" to respond whereas the other option would be the government "forcing" the breakup.

manfredo 7y ago
Revoking 230 would disrupt big sites, but would likely further cement their monopoly. Liability for user generated content means that sites that feature user generated content need to spend a lot of resources on moderation, because the consequences of a false negative are large. People who talk about section 230 breaking up large companies seem to be harboring the assumption that section 230 will only apply to large companies. This is not the case. It will be a massive blow to any site that features user generated content. A blow that only large sites have the resources to withstand.
- Techies4Trump 7y ago
  I think if this happens, decentralized social networks will really take off. The "small sites" you refer to , which I'm assuming are typical forum type sites, have been dying a slow death for the past few years anyway, since FB ate their lunch.
  - manfredo 7y ago
    Small sites would be absolutely devastated because the threat of being held liable for user comments will be way too large of a risk. Small networks don't have the resources to pre-moderate comments or build sophisticated automated systems of identifying high risk content. How many people would host their own site when the consequences of user-submitted illegal content being posted could mean millions in liability? Very few, if any. The result is that large players are the only ones that can survive in a market where companies are held liable for user submitted content. Maybe if by "small" you're talking about dozens of people. But I fail to see how comparably small sites like Hacker News could continue to exist without section 230 protections. It'd probably take fundamental changes like charging users a subscription in order to pay for enough moderators to pre-moderate comments and submissions and I am unsure if that's even a viable approach.

heavyset_go 7y ago

Revoking Section 230 would make option 1 unviable, too, as liability for user content is waived by that particular section of the CDA. Without Section 230, all interactive computer services are liable for content they host and serve to others, even if they choose not to moderate it.

mr_toad 7y ago

Congress would backtrack in a hurry as soon as it affected their campaign platforms.

krilly 7y ago

It's worth mentioning that nearly every board on 8chan IS moderated, by the board owners. Its exactly the same as the Reddit model, paid admins only enforce the few site wide rules and board owners are left to moderate their boards however they see fit. That might be heavy or light moderation, but if people are upset with the moderation style they just make another board.

RestlessMind 7y ago

There is a 4th option - treat certain surfaces of social media companies, mainly the user specific pages (Donald Trump's twitter page, PewDiePie's YT channel etc) as a platform; treat other surfaces which are generated based on algorithms and not directly by individual users (FB feed, YT watch feed, reddit homepage etc) as a publisher. That way, social media companies won't be responsible for what their users upload. But they will be responsible for what they present to their users to optimize clicks / engagement / revenue etc.

zapita 7y ago

> What problem does revoking section 230 solve that antitrust law doesn't? From the point of view of AG Barr, whose objective is to weaponize the DOJ for the purpose of expanding Russian oligarch interests in the US, revoking section 230 is effective because it is laser-focused on tech companies. On the other hand, antitrust law affects all monopolists in all industries equally - and most of those monopolists are Barr's allies. He doesn't want to bite the hand that feeds him.

Canada 7y ago

I think there might be a 4th option for moderation: Local filtering like ad blockers. Perhaps if big centralized platforms came with stricter liability there might be an opening for more open/distributed protocols once again.