26 ms·
Is content moderation a dead end?
- endisneigh 6y agoMy response to the title is: "No, but it requires more resources than most are willing to admit or give." The crux of the issue is that there's no "cost" to be bad. If there was a "cost" then bad actors would go away for quickly. Any "cost" you impose will be diametrically opposed to popularity - but a low volume/unpopular site is unlikely to be abused to begin with.
- throwaway3699 6y agoThe problem is the costs of content moderation are not linear. You are not dealing with a few thousand trolls. You're dealing with bot farms impersonating possibly over a million accounts. Huge groups of networks operated by just a few dozen people. Automating that away is the only path to being on equal footing. If you introduce any human element, not only will it be a bottleneck, but the cost could be large enough to bankrupt even the largest companies.
- cryptoz 6y ago> but the cost could be large enough to bankrupt even the largest companies. In my opinion, if you can't hire enough people to moderate without going bankrupt, then bankrupt you go! Would this mean we can't have social media? Maybe. Probably for the best. But you can't moderate then you go out of business. That's the way it should be. Probably then people would find a way to moderate and stay afloat.
- throwaway3699 6y agoThat would apply to every website with a comments section, sadly. I think the solution to this is smaller, more isolated groups -- with limited edges between. Back to email threads and Mumble servers, imo. The downside is we'll all be living in filter bubbles, but I think any shared community with a common value (like a video game) is better than some ginormous platform like Facebook.
- denimnerd42 6y agoI am really disappointed that all the php bulletin board forums I used to visit as a teen and young adult have all died off or been sold to an advertising conglomerate and most of the users have fled to Facebook groups. Facebook is just not the same as a forum. The quality of posts is lower, the reposting is much higher, and the sense of community is actually lost. Facebook has even killed craigslist. Or at least greatly reduced the usefulness.
- tonyedgecombe 6y ago>The downside is we'll all be living in filter bubbles That already seems to be the case.
- johnnyanmac 6y ago>Would this mean we can't have social media? Maybe. Probably for the best. the vast majority of websites operate perfectly fine without a comment section (and some already have removed them). This isn't as far off a reality as you jest. In any case, it's ultimately a cultural choice, like any other social element. Maybe America somehow bans comments without ties to real world ID and all the major american sites pivot into little more than coporate news aggregators. It wouldn't stop other countries and their respective forums that users seeking discussion would run to. And I doubt there would be some strong enforcements to make sure Americans aren't commening on WeChat or Weibo or some other non-American service.
- kingsuper20 6y ago"You are not dealing with a few thousand trolls." In my own experience, it's the trolls that are rather confounding. Go to any twitter poster with even a slightly political bent. Look for the first shitty person. Look at their posting history. It'll nearly always be 100 post/day of shittiness telling you just what you need to hear. Unless the evil Russians are extremely clever, it all appears to be grassroots poor behavior. I guess you can view social media as a giant laboratory showing the behavior of people when they are not nose-to-nose with you in a bar. It's all super disappointing. Maybe there's a place for highly curated social media.
- michaelmrose 6y agoHow about making people put down a bond of even a small amount say $10 and something tied to your actual ID. The registrar knows who you are but sites only know you are a verified person but not who you are. If you are found to be a fake person you forfeit the bond. Now it costs $100,0000 to create 10k fake people and you can lose it all tomorrow.
- drdeca 6y agoThis seems nice, but it would be nicer if there was a cryptographic way to be sure that the site couldn't obtain your id from the registrar. Is this doable? Or maybe these requirements together are contradictory?
- michaelmrose 6y agoIf you are using an email to sign up and verifying that user actually controls email as is normal presumably they could look up the bond with your email. Essentially registrar and major sites would coordinate to get bot accounts revoked your registrar wouldn't want to cancel user accounts erroneously. In most cases logically the registrar could be your email provider which would just be selling a verified email address but a third party could offer the same thing.
- mikepurvis 6y agoEven with infinity resources available for manual human moderation, you eventually hit a wall where different sub-communities will simply have different standards for what is acceptable to them— what might be reasonable debate in one circle is gaslighting and triggering to people elsewhere. It's not really up to the platform to impose a global code of conduct, and attempting to do so (outside of banning the most obvious of bad behaviours or things that are actually illegal) never seems to go well for platforms. So yeah, I agree with TFA in the sense that these are problems to be solved largely at the system level. For example, compared to Twitter (where anyone can reply-to, quote, RT, and @user anyone), Twitch and Tiktok seem to do well at permitting individual creators to have their own space with their own exclusive authority over what is and isn't okay in the space. And they have (or at least enable to exist) lots of tools for exerting that authority— witness things like "bye trolls" scripts on Twitch that do have to be set up in advance, but then can be used at the drop of a hat in response to brigading to immediately close the stream to new followers, and disallow posts from non-followers, plus delete chat posts from anyone who joined the stream in the last X minutes.
- deleted 6y ago[deleted]
- johnnyanmac 6y ago>you eventually hit a wall where different sub-communities will simply have different standards for what is acceptable to them with the utopic assumption of infinite moderation, I don't see a problem here. Different houses will have different rules and levels of moderation (a meme community will have different standards from a more sensitive topic). As long as the moderation informs newcomers of the rules, they behave under that sub-community if they choose to participate (while respecting global community rules, and of course server country laws). This is all under the assumption that "sub-community" is distinctly defined. For something truly monolithic like Twitter, the only choice seems to be to leave control to the individual, and perhaps allow private groups to be formed.
- paxys 6y agoAgree with the author that moderating every interaction on a social network is a fool's errand. I'd go a step further and say that the future isn't simply restricting some features like links and replies, but rather more closed networks where entry is guarded (think PC software downloads -> app stores) and only a very limited set of specialized actions and interactions is allowed (think app sandboxing).
- incompatible 6y agoThere are already platforms where you can set up closed groups, if you want one. Banning links or replies seems a lot more heavy-handed than content moderation.
- anyfoo 6y agoObviously not, since we’re discussing it on a site with content moderation right now that, in my opinion, works much better than sites without.
- yesOkButt 6y agoHN is hardly as diverse a site to moderate as YouTube and Reddit Should all forums rules conform to HN?
- tomcam 6y agoDownvoted for sophistry and complete lack of addition to the discourse. Or do you happen to do a better job moderating a site elsewhere?
- anyfoo 6y agoI personally don’t think your comment puts the effectiveness of moderation is in question, just the efficiency. So yes, I think places like YouTube and Reddit would greatly benefit from similar moderation (the rules don’t have to be exactly the same), but the difference in scale and, as you note, variability in the rules for different parts of those sites makes it so much harder to apply.
- yowlingcat 6y agoIt's worth noting that IMO, the scale is not just volume (depth) but also cultural heterogeneity (breadth). HN is for all intents and purposes a single community with a stated set of values. It's not a constellation of communities some of which are polar opposites of one another. The question of moderating Reddit always boils down to /which subreddit/ -- I don't even know where to start with YouTube.
- deleted 6y ago[deleted]
- kodah 6y ago> HN is for all intents and purposes a single community with a stated set of values In the sense that we all value curiosity, yes. We are all also very different. When political posts go up you see it; value, perspective, economic, and educational differences are all highlighted simultaneously. I think what keeps us from destroying each other is that the binds that bond are curiosity, and those bonds are strong enough for now. dang also sacrifices his sanity going around and nudging people back in the right direction. Those bonds are nothing to be understated though. I've tolerated some edgy opinions on this website, and probably given some too, but I also come here to learn about different perspectives and genuinely do enjoy them even if some offend or hurt me. Other people see those differences and talk about making lists.
- tomcam 6y agoWe are lying to ourselves, and we are doing it through colonialization writ large, once again. People who use Twitter and Facebook seem to be completely unaware that thousands of content moderators in the Philippines are being subjected to images of utter depredation and cruelty by the minute because we refuse to take responsibility ourselves. History will not look well on what we did to these these heroic underpaid people. I do not blame Mark Zuckerberg, whom I despise. He is doing this with our full consent. In my view the only proper way to handle content moderation is that every user of these “free“ social media platforms over the age of 18 should should be required to moderate some proportion every month to understand what’s actually going on.
- cryptoz 6y ago> In my view the only proper way to handle content moderation is that every user of these “free“ social media platforms over the age of 18 should should be required to moderate some proportion every month to understand what’s actually going on. Does that mean no vetting at all of the moderators? Anybody can become a moderator? But then you have QAnon in large numbers moderating content on like the CNN Facebook page or something? I really, really, really don't think that is a "proper" or even tenable moderation solution. There are too many people who would abuse the moderation power. Moderation should at least be a paid position, paid well in fact, and vetted before allowed to moderate. Otherwise it will be worse than before.
- tomcam 6y agoThose are great points. I believe that there should be essentially no censorship at all, subject to First Amendment restrictions. Posts could be hidden to people based on age, political, or other preferences, but would always be accessible to adult users willing to sign a waiver. I believe very much that bad material no matter how disgusting is best handled through public exposure, not censorship.
- mdoms 6y agoHow do you deal with misinformation? Anti vax misinformation could literally devastate an entire society if given enough oxygen. Are your free speech ideals more important than the health of an entire economy and hundreds of thousands of lives at risk?
- PicassoCTs 6y agoYears ago, i suggested a algorithmic approach to moderation to a Open Source project i contribute too. They ultimately went another way (classic moderation), but the idea was pretty neat. You basically create a feudal vouching system, were highly engaged community members, vouch for others, who again vouch for others. If people in this "Dharma-tree" accumulate problematic behaviour points, the structure at first, bubbles better behaved members to the top. If the bad behaviour continues, by single members or sub-groups, the higher echelon of members will cut that branch loose, or loose their own social standing. Reapplying members, would have to apply at the lowest ranks (distributing the work) and those would risk dharma loss if they vouched for sb unworthy in the trial out phase. We never solved the bad tree problem though. What if there exists a whole tree of bad apples vouching for another? You can not rely on the other feudal "houses" indicating this correctly, due to ingame rivalry.
- deleted 6y ago[deleted]
- marcosdumay 6y ago> What if there exists a whole tree of bad apples vouching for another? That's when you add top moderation, so the algorithm becomes a way to scale the moderators, not a full moderation solution. You can't create an algorithm that solves moderation, unless you create a fully featured AI with a value system.
- remram 6y agoYou can also test this, similarly to how Stackoverflow does it: send people a post that you know is bad (or good) and check that they flag it. If they don't, let them know that they are doing it wrong, lock them out of moderation, or silently ignore their voting and use it as a signal of voting rings.
- clairity 6y agoyes, let computers do the repeatable work and humans do the original thinking. i still haven't seen a moderation system better than slashdot, which community-sourced its moderation/meta-moderation semi-randomly. though it still had issues with gaming and spam, it seems like a good base to build from. and yet we ended up with twitter, facebook, reddit, yelp, etc. that optimize for (ad) views, not quality.
- jaredwiener 6y agoOn a little bit of a corollary -- “Who gets to decide what’s true?” is the wrong question. We should be asking “how do we determine what’s true?” https://blog.nillium.com/fighting-misinformation-online/ https://blog.nillium.com/fighting-misinformation-online/
- numpad0 6y agoDreadful as it sounds, maybe the truth truly don’t matter. You don’t have to live fully anchored down in the baseline reality, just your worldview has to be able to do more than sustain you. Maybe it’s okay to be waist deep into QAnon schizophrenia so long as the rest of your life is also okay, and vice versa. Though those imaginations aren’t the kind of powdered grape juice to me.
- ozymandium 6y agoWho is this "we"?
- wpietri 6y agoSigh. A "certain level of bad behaviour on the internet and on social might just be inevitable" has been an excuse since the beginning. I worked on the first web-based chat, bianca.com, and I heard it back then. More recently, I worked on anti-abuse at Twitter a few years back and hear the same talking point. Now I work on the problem at a not-for-profit, and it's still a talking point. Ignoring that the social media landscape has shifted dramatically over the decades, as have the technologies and our understanding of the problem. It was always a terrible point, but it's especially ridiculous to see techno-utopians turn techno-fatalists in an eyeblink. The same people will go right from "innovation will save the world" to "I guess progress has now stopped utterly". And what they never grapple with is who is bearing the brunt of them giving up. I promise you it's not venture capitalist and rich guy Ben Evans who will be experiencing the bulk of bad behavior. It's easy enough for him to sacrifice the safety of others, I suppose, but to me it seems sad and hollow.
- benedictevans 6y agoI did think I’d made it extremely explicit that I don’t think any of that at all, but perhaps not (although the way you throw in a rather childish ad hominem sneer suggests you’re not thinking very clearly). What I actually wrote is that though (of course!) there will always be some bad behaviour, we want to minimise it (I compare it to malware, for heaven’s sake), but moderation might not be the best way to minimise it, and we might need different models. As it happens, I would suggest that the idea that somehow we CAN just stop all of bad human behaviour online would be the most extreme techno-utopianism possible.
- wpietri 6y ago> ad hominem [...] you're not thinking very clearly Huh. Not totally sure you understand what "ad hominem" means. But moving on from that, I'm not objecting to the notion that we might need different models. The way we do anything today is unlikely to be the best way for all of time. Given that I've spent years trying to improve things, perhaps you can take it as read that I think we can improve things. What I'm objecting to is your fatalism that bad shit is probably going to happen to somebody (a note you include in your closing paragraph) combined with your failure to examine exactly who's going to bear the brunt of it. Something you conspicuously didn't do in your reply here, instead suggesting it's some sort of shocking rudeness to point out that as a rich person, it's unlikely to be you.
- cblconfederate 6y agoNot just content moderation but also app moderation. And moderation has gone hand-in-hand with vertical integration which is bad for innovation. Soon facebook will be writing people's posts for them (because you can't trust people with keyboards) and apple will be delivering a computer together with the software soldered in a SoC. Both solutions will be bad for innovation though, they 'll be making a very fast horse, but both will miss the next big thing.
- root_axis 6y agoThe system works as it is. Each website does its best to moderate content without harming the business. From a business perspective, it'd be ideal to never moderate content, because more viral content means more money, but advertisers, governments, and users have a problem with some content, so the websites have to take a more nuanced approach to balancing the desires of these groups. At the end of the day, there is no perfect solution, but that's ok, the web is a federated network of websites and each node can set their own priorities with respect to the interests they determine make the most sense for them, leaving the users and advertisers the freedom to use as few or as many websites as suit their own prerogatives.
- bjt2n3904 6y agoThis article is absolutely fantastic. Excellently written. I've always maintained Facebook made a mistake when they took responsibility for misinformation posted on their platform. Now, four years later, they're continuing to double down on this stance, and forming "ministries of truth". Freedom of speech is a powerful concept, and does not like to be stifled by types that argue it should only apply to the government. When you fight against that principle, you win in the short term, and lose in the long term. We are now starting to see those ugly realities of the long term losses, four years later. The author is touching on something prescient here, but I disagree with some of his observations. For example, that the solution to "virus scanners" playing whack a mole was to move to cloud computing. (The solution was clearly to improve software, with things like memory safe programming langauges. Moving to cloud computing reduces freedom, not enhances it, and centralizes all the valuables in a single location a la Tower of Babel.) If you remove the "algorithmic feed" mechanic, much of the abuse vanishes instantly. I am shown what came latest. Not this weird algorithmic mash of content that has been gamified for my attention. RSS is the way to go.
- kingsuper20 6y agoAny ex-Usenet moderators out there? I don't remember this being such a huge deal, and there was always the alt groups.
- Mediterraneo10 6y agoThings have changed since the 1990s. Some mild homosexual slurs might have made their way through Usenet moderation, and trans issues were not even on the radar. Today, those favouring content moderation expect what they see as anti-LGBT attitudes to be filtered out. Also, Usenet was so niche that state actors weren’t running troll armies for propaganda purposes, but this is something any modern social network has to deal with.
- jfengel 6y agoA lot of the language we use for dealing with moderation was developed for Usenet and related systems: trolling, spam, flames, etc. The problem was bad enough that we developed names for it. There was certainly less of it; all of Usenet fit in a box of magtapes. But it could still have some pretty big tempests in that teapot. It never even got close to solving spam, which exploded after Eternal September. It took AI-esque systems (and enormous heaps of data to feed them) to reduce spam to a manageable level. Trolling is a harder problem than spam.
- gregw2 6y agoJust to chip in a comment about the size of Usenet... I did some analysis comparing Slashdot (with distributed moderation) traffic volumes to Usenet (centralized moderation) in the late 90s. If I recall, the peak volume of posts to the largest (moderated?) Usenet newsgroup was about 3000 posts/day. I seem to recall it was alt.fan.rushlimbaugh or something. I don't know about the quality of moderation but I took that to be the "peak traffic a single/paired human moderator" could handle before we had databases and distributed user-moderated content. Not sure what dang et all are handling here but it seems higher than that nowdays (but not more than 10x higher with all the newer technology they've developed?)
- bombcar 6y ago
- nxpnsv 6y agoI'd love seeing an anonymous peer review approach, to post anything you need to review X other posts. Until there are N accepts posts are invisible. I think it could work, but I am sure HN can tell me how I am wrong :)
- Viliam1234 6y agoIn other words, before posting you need to randomly click on X other posts, and to make your posts visible, you need to have N accounts. I believe I could write such script in an afternoon.
- nxpnsv 6y agoI even started, but I have no social network to go with it so I stopped. It should also work for reviews.
- dredmorbius 6y agoThere's still the Sybil problem. And good submitters != good reviewers. That said, a variant in which less vetted content has to be reviewed by more vetted reviewers, before gaining wider disclosure, seems to me to have merits.
- nxpnsv 6y agoGood point. Currently I think good submitters are rewarded by karma/likes etc, maybe rewarding good reviewers would useful too.
- minikites 6y agoI think content moderation can be effective in smaller communities where social norms can be formed and effectively enforced. Perhaps the problem is that Facebook and Twitter are too large to be allowed to exist?
- ddingus 6y agoThere are at least a few kinds of bad: Spam, google bombing, and related activities. These are noise, generally. Misinformation is slippery. Often this gets conflated with differences of opinion. That is happening a lot right now as moderation is politicized and weaponized. More than we think is debatable and should be debated rather than legislated or canonized into an orthodoxy, flirting with facism. Clearly criminal speech, kiddie pr0n, inciting violence, etc. These are not noise and can be linked to either real harm as a matter of the production of the speech (kiddie pr0n), or can be linked to the very likely prospect of harm. Material harm, is an important distinction segway to: Offensive material. Being offended is as harmful as we all think it is. Here me out, please: To a person of deep religious conviction, some speech can offend them just as deeply. They may struggle to differentiate it from criminal speech, and in some parts of the world this is resolved by making the speech criminal anyway. Blasphemy. That same speech might be laughable to some who are not religious, or who perhaps hold faith of a different order, sect. Notably, we have yet to get around to the intent of the speaker. Say the intent was nefarious! That intent would hit the mark sometimes, and other times it would not. Say the intent was benign. Same outcome! With me so far? Before I continue, perhaps it makes sense to match tools up with speech. For the noise, rule based, AI type systems can help. People can appeal, and the burden here is modest. Could be well distributed with reasonable outcomes more than not. Potentially a lot more. Misinformation is a very hard problem, and one we need to work more on. People are required. AI, rule based schemes are blunt instruments at best. Total mess right now. For the criminal speech, people are needed, and the law is invoked, or should be. The burden here is high, and may not be so well distributed, despite the cost paid by those people involved. Offensive material overlaps with misinformation, in that rule based, and AI systems are only marginally effective, and people are required. Now, back to why I wrote this: Barring criminal speech, how the recipient responds is just as important as the moderation system is! I said we are as offended as we think we are above, and here is what I mean by that: Say a clown calls you an ass, or says your god is a false god, or the like. Could be pretty offensive stuff, right? But when we assign a weighting of the words, just how much weight do the words of a clown carry? Not much! And people have options. One response to the above may be to laugh as what is arguably laughable. Another may be to ask questions to clarify intent. Yet another option is to express righteous indignation. Trolling, along with misinformation share something in common, and that is they tend to work best when many people respond with either righteous indignation (trolling), or passionate affirmation and or concern. (Misinformation) Notably, how people respond has a major league impact on both the potency and effectiveness of the speech. How we respond also has a similar impact on how much of a problem the speech can be too. There are feedback loops here that can amplify speech better left with out resonance. A quick look at trolling can yield insight too: The cost of trolling is low and the rewards can be super high! A good troll can cast an entire community into grave angst and do so for almost nothing, for example. However, that same troll may come to regret they ever even thought of trying it in a different community, say one where most of its members are inoculated against trolling. How? They understand their options. Righteous indignation is the least desirable response because it is easily amplified and is a very high reward for the troll. Laughing them off the stage can work well. But there is more! I did this with a community as it was very effective: Assign a cost to speakers who cost more than their contributions deliver value! Also, do not silence them. Daylight on the whole process can be enlightening for all involved as well as open the door for all possible options to happen. People showed up to troll, stayed for the high value conversation and friends they ended up with. Others left and were reluctant to try again. The basic mechanism was to require posts conform to one or more rules to be visible. That's it. Example costs: No 4 letter words allowed. Contribution must contain, "I like [something harmless]" Contribution may not contain the letter "e". And they have to get it right first time, and edits are evaluated each edit. Any failure renders the contribution hidden. Both of these did not limit expression. They did impose a cost, sometimes high (no letter "e"), sometimes subtle (no four letter words)... But what they did do was start a conversation about cost, intent, and
- justbored123 6y agoThis is extremely short sighted. The complete opposite is more likely to be true. Privacy is almost dead and soon it will be almost impossible to hide your real identity on the internet and thus avoid consequences for your actions. That will allow companies to black list you across the internet, so if you are an a-hole in lets say Facebook by harassing people, doxing them, do child grooming, scams/fake advertisement, etc. and Facebook bans you because you are bad for advertisement, they are going to be able to put you on a black list and ban you in all other sites even if you use a different IP, browser, account, etc. There are endless ways to tell you are the same person and it's getting worst, for starters you phone, SSO, browser/extensions fingerprinting etc. It's going to be a lot like your credit score, your criminal record, etc. At the end of the day companies want advertisement money and if you scare the adds away the same networks that control those adds are going to end up keeping track of you to keep you away. Once that anonymity is completely gone, the internet will be just like real life. If you are a problematic assh*le, you'll get a record saying just that that employers, land lords, schools, etc. are going to check, just like they do now with credit scores, criminal records and school records and if you don't behave, you are going to be a marginal banned from polite society like it happens in real life outside the internet.
- proc0 6y ago> That will allow companies to black list you across the internet Thus giving full control of people to private entities that are increasingly not held accountable by anything or anyone. Why would we want a private entity, not elected by the people, to decide our morality? Enforcing morality is dangerous and arguably immoral since it uses force to align people's thinking, which treats everyone like children that are learning instead of adults with freewill.
- gumby 6y ago> Anyone can find their tribe, ...but the internet is also a way for Nazis or jihadis to find each other. I'm delighted that the net is a way for nazis and other jihadis to find each other. It's a global honeypot. Driving them underground doesn't make them go away, just harder to find. We saw this with the January 6th crowd. We also saw this with the publicity-seeking attorneys general who got rid of craigslist hookups and back page: sex trafficking continues but is harder to find and prosecute.
- watwut 6y agoDriving them underground makes them weaker and less influential. I don't need them to be known. I want them weak.
- miki123211 6y agoI think we're looking at the issue in a completely wrong way. There's no objective definition of right or wrong in content moderation. Right and wrong is subjective, especially across cultures, and moderation should be subjective too. I believe end users should have the choice to adopt blocklists, Adblock style. Those lists could contain single posts, accounts, or even specific words. A lot of content (like flashing images or spoilers) does not merit deleting, but there are users with good reasons not to see it. They should be given such an option. There should be a few universal, built-in blocklists for obvious spam, phishing, child porn etc, but all the rest should be moderated subjectively. A Clubhouse-stule invite system (with unlimited invites) would also be a good idea. It would make it much harder for spammers, cammers and troll farms to make new social media accounts.
- alex_g 6y agoClubhouse is not a great example of a platform that handles abuse properly. Putting the moderation burden on people is also not a solution, it's duct tape.
- simmanian 6y ago>Putting the moderation burden on people I don't think GP is saying we should put the moderation burden on people. When you accept that there is no objective definition of right or wrong, you begin to see that perhaps there are ways for people to self-organize on the internet according to their values rather than being shoved into the same box like we often do today. Many people are looking for ways to efficiently and effectively organize on the internet in a more sustainable manner.
- alex_g 6y ago"Right or wrong" maybe not, but for well managed communities on the internet, there are objective definitions for appropriate and inappropriate, based on shared values and context. If you leave it up to each individual to decide what is appropriate or inappropriate, and provide them with the tools to block content they consider inappropriate, that's a burden on them, because you're not taking care of it at the community level. And if the community's strength comes from shared values, and you leave that up to each individual to decide, what's shared, and what sort of "community" is actually offered?
- alex_g 6y agoThis is a weird take. You get lots of messages from Nigerian scammers, but the solution was not to prevent people from writing freeform emails. The solution was to build powerful spam detection algorithms, make it easy for people to classify emails to help strengthen the training set, and the problem is basically solved. There's no easy answer to content moderation. There's no one size fits all solution, nor is there is some weird hack that's going to fix it. It's a part of your product. If you treat it as such, you're better off. If you treat it as a separate problem that just needs money thrown at it or duct tape wrapped around it, you're never going to stop throwing money and tape at it. Everyone wants an easy way out. You need everyone on your team in the room brainstorming solutions.
- kiba 6y agoThe problem isn't solved, just surpassed, given that Nigerian spammers continue to make money.
- alex_g 6y agoFair, though I'm curious if the people falling for them are using email providers with quality spam filters. I'd guess it's a much older crowd that's more likely using an archaic email provider with no incentive to improve spam filters.
- pdonis 6y ago> I'm curious if the people falling for them are using email providers with quality spam filters. I'm curious why the people falling for them need a spam filter to recognize them as scams. I still see an occasional one slip through my email provider's spam filter, and I've never had any problem figuring out that they were scams.
- alex_g 6y agoBecause not everyone has competent internet skills.
- proc0 6y agoI agree with the article but it's a bit shallow or too short maybe. It's not factoring identity, which is a huge factor when it comes to moderation. Most accounts are basically people being anonymous in respect to their real identity. Then there is bots and AI, and the problem of detecting who is legit or a bad actor. Therefore, having a relatively miniscule number of people be the judge and expect them to not abuse power, or thinking some clever algorithm won't be exploited, is short sighted and maybe technically naïve. I don't know what the solution is, but it might be having the Internet become independent from all nations, and have it be its own nation with laws, etc... not sure, but it does seem like an analogous problem to physical humans living together in a civilization, it's just still in the making, it seems.
- foxhop 6y agoI disagree with the sentiment and conclusions drawn in this post. Moderation is not dead, here is my public response: https://www.remarkbox.com/remarkbox-is-now-pay-what-you-can.html https://www.remarkbox.com/remarkbox-is-now-pay-what-you-can....
- Animats 6y agoOpen systems ungood. Duty of thinkpol to enforce goodspeech. Prevent crimethink. Users read only prolefeed.[1] [1] https://genius.com/George-orwell-nineteen-eighty-four-appendix-the-principles-of-newspeak-annotated https://genius.com/George-orwell-nineteen-eighty-four-append...
- contextfree 6y agoI'd (sincerely) appreciate if you'd expand on this in more considered language. After reading the article I was hoping to see more comments here reacting to and engaging with the central analogy this essay is built around (between the evolution of desktop and mobile client software platforms and the evolution of social media) but was disappointed to see that nearly all the comments ignored it and just made some tenuously related point about content moderation in general. Your comment on the other hand seems to react (negatively, which is fine) to the central analogy, but its knee-jerk hostile phrasing is unlikely to be appreciated (or even understood) by anyone who doesn't already know what you're talking about and share your sentiments. So, if you were to phrase your sentiments in a more friendly (to the public, not necessarily to the writer of this essay) manner it could make this comments section more interesting and potentially fruitful.
- motohagiography 6y agoIt's hard to separate content moderation from the problem of Evil. Low entropy evil is easy to automate out, high entropy and sophisticated evil can convince you it doesn't exist. This is also the basic problem of growing communities, where you want to attract new people while still providing value to your core group, while still managing both attrition and predators. What content moderation problems have proven is that even with absolute omniscient control of an electronic platform, this is still Hard. It's also yields some information about what Evil is, which is that it seems to emerge as a consequence of incentives more than anything else. In the hundreds of forums I've used over decades, the best ones were moderated by starting with a high'ish bar to entry. You have to be able to signal at least this level of "goodness," and it's on you to meet it, not the moderators to explain themselves. There is a "be excellent to each other" rule which gives very reasonable blanket principle powers to moderators, and it's pretty easy to check. It also helped to take a broken windows approach to penalizing laziness and other stupidity so that everyone sees examples of the rules. Platform moderation is only hard relative to a standard of purity as well, and the value of the community is based not on its alignment, but on its mix. If you are trying to solve the optimization problem of "No Evil," you aren't indexed on the growth problem of "More Enjoyable." However, I don't worry too much about it because the communities in the former category won't grow and survive long enough to register.
- pdonis 6y ago> In the hundreds of forums I've used over decades, the best ones were moderated by starting with a high'ish bar to entry. I've had the same experience. And at the other end of the spectrum, the reason Facebook, Twitter, etc. have such problems with moderation is that there is no bar to entry--anyone can sign up and post. With what results, we see.
- motohagiography 6y agoAgreed, with a thought: I actually think that Facebook's business model was premised on the Steve Carell movie, "Dinner for Schmucks," where a tool originally designed to signal you went to an ivy school got that cohort on board, and then invited everyone else for as kind of a cruel joke where they didn't know they were only the entertainment. Now the party's long over and the only people left are loud drunks yelling at each other and couples acting out some very public domestics. Imo, there is no solution to those platforms' moderation problems, only management into something even more banal and worthy of disruption.
- lifeisstillgood 6y ago>>> One could also think of big European cities before modern policing - 18th century London or Paris were awash with sin and prone to mob violence, because they were cities. Is the solution in the article? Do we simply need to recognise that as all society is online we now need online police? Online Community support officers (UK police adjuncts (think teaching assistants). I suspect there is an overlap with the "defund the police" movement and the notion that we need to take away a lot of policing functions that are not actually violence / crime related - eg mental health. Social work is .. a lot of work. Edit: It's worth noting that there are ~24 million or more police officers whose job description simply did not exist before Sir Robert Peel. That's a bigger number than i imagined ! wow: https://www.worldatlas.com/articles/list-of-countries-by-number-of-police-officers.html https://www.worldatlas.com/articles/list-of-countries-by-num...
- intended 6y agoYes. And that brings up the issue of how, exactly, are we supposed to allow a literal “thought police”.
- lifeisstillgood 6y agoIt's not a thought police firstly. It's a published statement police (pretty sure there are lots of laws like "disturbing the peace") This will play out over time - call it 30 years - as we try to find out how to do lots of new things - Handle mental health better. Partly we need medical breakthroughs, but social acceptance will be a huge improvement, as will standardised approaches, early years interventions and detection. It will take huge amounts of parent training - and the recognition that has genuine costs (how many start ups did not start because the parent decided to put their energy into supporting a child. And woe betide anyone suggesting that is another hurdle to be overcome with go getting attitude) So we need huge investment in dealing with chronic mental health, not just medical, but social support, education etc. - then sorting out acute. Look at any UK prison. It's basically young men with some mix of drug / mental health / abuse issues. Want to reduce the prison population - start 20 years ago. Don't define the police - simply introduce interventions so that in 20 years they won't need to do the social work job they do now There is probably a dozen brilliant papers on this clearly showing what we should do and already modelled in a few enlightened communities globally. But it's going to take a decade of mistakes before those percolate up. Let me know if you spot the me early. After that it's social norms. We are trying to find a set of behaviours that are acceptable in the new online spaces. Public urination is frowned upon IRL - trolling is the online equivalent I guess. One can imagine things like loss of anonymity being the first part. Then slowly people develop tools to use humans inbuilt social mechanisms - so for example some asshat is intolerable, a record of their conversation is sent to the mother-in-law, 4 grandparents, all their wife's bridesmaids. (this may not work but you get the idea). We know this sort of thing works because every so often we all find that great viral thread where someone gets a comeuppance. All of this does demand content moderation as ben says - and yes I do think all of this is too much. My take is social media will die back to manageable levels - if we are looking at a mass crowd situation, a swirling football crowd and asking, how can this crowd ever become a manageable city. Well crowds don't - crowds become cities, they disperse. - There are too many forms of social media - each of us has one main form, and keep up with rest - just as we would have one friend in a crowd but interact with others. This will just die down. I mean how much value do we get from social media versus the constant worry / mind back that makes us check all the time. as humans develop social media innoculations this will die back Secondly ad dollars will help die back social media - really it's amazing no one has noticed it's a scam and waste money f money. At some point regulations and advertising will drive to a point where it is simply easier to dump the algorithm, stop driving for engagement and just supply the limited feed of friends posts, interspersed with billboard ads. Influencers will still influence, ads will still pop up, but as we are choosing who to follow we won't care. Just follow fewer people. Agents - the other big silent one. I can run a refer over my emails but the facebook client won't let me. This is the other big change likely to occur - software agents acting in my best interest filtering shit for me. Anyway bed time
- Viliam1234 6y agoModerating a forum where anyone can post is playing whack-a-mole, especially if registering the new account is simple. One possible approach is something like Stack Exchange does: new users acquire their rights gradually. New accounts can only do little damage (post an answer that appears at the bottom of the list, and is made even less visible when someone downvotes it), and if they produce bad content, they will never acquire more rights. Another possible approach would be some vouching system: moderator invites their friends, the friends can invite their friends, everyone needs to have a sponsor. (You can retract your invitation of someone, and unless someone else becomes their sponsor, they lose access. You can proactively become a co-sponsor of existing users. Users inactive for one year automatically retract all their invitations.) When a user is banned, their sponsor also suffers some penalty, such as losing the right to invite people for one year. There are probably other solutions. The idea is that accounts that were easy to create should be even easier to remove.
- dmos62 6y ago> vouching system https://en.wikipedia.org/wiki/Web_of_trust https://en.wikipedia.org/wiki/Web_of_trust I've not examined it closely, but Web of Trust follows that train of thought at least to an extent.
- rocqua 6y ago"Trust" in this context means "I believe this key indeed matches this identity". Nothing more is meant by that.
- dmos62 6y agoThe feature I'm talking about is direct vs indirect trust in WOT. If an indirect trustee is deemed untrustworthy, it may say something about the chain of direct trust links leading to him. If someone I introduce into the trustee network turns out malicious, I might get somehow penalized, as well as others I introduced. I realise WOT is designed with authentication in mind, but maybe it could serve more general trust systems. Not sure.
- 6y ago
- tunesmith 6y agoI see it as kind of a funnel. First you decide how much participation you want to allow in the first place, and that's a big lever. Smaller niche communities are easier to moderate because a lot of policies are customs, meaning you don't need to make them explicit. Another lever is related - decide how much you want to limit the kind of content. A like button is easier to moderate than upvote/downvote, which is easier than a poll response, which is easier than restricted markup, which is easier than allowing unsanitized html/js/sql. (I think there's a lot of unexplored territory between "poll response" and "restricted markup", in terms of allowing people to participate with the generation of content.) Then there is distributing the moderation abilities themselves. Can users become moderators or only admins? Is there a reputation system? I miss the kuro5hin reputation system and would like to see more experiments along those lines. And then finally you get to the hard stuff, the arguments about post-modernism and what truth is, creating codes of conduct, dealing with spirit-vs-letter and bad faith arguments, etc. Basically the "smart jerk" problem. I hate that stuff. I want to believe something simple like, as soon as you have a smart jerk causing problems, it means you've given them too much opportunity and should scale back, but I think it's not that simple.
- dredmorbius 6y agoKuro5hin's moderation and reputation system had some novel-for-the time (and still comparatively rare) features, though it ultimately suffers much the same failure as most other crowdsourced moderation systems, and ultimately doesn't work under sustained attack or concerted effort. For those unfamiliar, Kuro5hin, inspired by Slashdot, was an online discussion site where individuals would submit items, along with a (hopefully) brief description, or an original essay. There was no editorial queue (as Slashdot had and has). Both posts and comments could be rated on a five-point scale by individuals, and the ultimate score landed in the bound 1-5 (later extended to 0 or -1 with flags). Moderation converged on a mean with time, at least in theory. Users "mojo" (karma) would follow similarly. This avoids both the runaway endless votes problem of sites such as Reddit (or Hacker News), and the behaviour of Slashdot in which moderation would rise or fall but never converge and was artificially capped at 5 points. On Kuro5hin, the 100th moderation score was weighted as 1/100. On Slashdot, the 100th moderation score had a weight of 1. If this sounds something like a star-based review system such as Rotten Tomatoes, or Amazon ... it's because it is. And ultimately the same problems apply: - Sybil attacks in which sockpuppet or shill accounts are created to sway moderation / review scores are quite possible. - If the site fails to attract (or motivate) consciencious moderators, the moderation quality still falls. - Information on divergent (strongly bimodal) rating is lost. 10 moderations split between 5 '1's and 5 '5's look the same as 10 '3' ratings. The information contained is not the same. (Summarising complex data is, it turns out, complex.) - There's still no distinction between popular and truthful content. Or between "this is true" and "I disagree with this" (or don't like it, or the submitter looks funny, or whatever). The K5 system was interesting, but ultimately not a magic bullet. The site itself failed, though for complex reasons.
- wolverine876 6y agoPeople with moderating experience: Why not just delete [most] offending comments, immediately, no questions asked (and ban repeat offenders)? For maybe 95% (as a wild guess), there's no question - it's clear that the comment is inflammatory or disinformation or whatever. It surprises me that I see so many of them permitted in so many forums, even here on HN. Why tolerate them? One click and move on. Tell people about the policy, of course, and if the comment is partly offending and partly constructive, delete it. They can re-post the constructive part. It's not hard to behave - we all do it in social situations. If you want your comment to be retained, don't do stupid stuff. ------------ Also, it's telling IMHO that in this conversation among people relatively sophisticated in this issue, organized disinformation is barely discussed. It's well-known, well-documented, and common, yet we seem to close our eyes to it. It's a different kind of moderation challenge.
- RobertRoberts 6y ago> "Why not just delete offending comments..." How do you define offending? Some people are offended by a great many things. China is offended if you point out they have human rights abuses. The US is offended if you point out their interference in other country's affairs. Thailand literally makes it illegal (jail time) to offend some people that in the US is not only legal, but encouraged by our culture! It's not so simple or easy.
- jonnycomputer 6y agoNo it is easy. You define offending as whatever the moderator finds offending. Like a strike in baseball. But you can always moderate the moderators.
- wolverine876 6y agoIMHO this argument is potentially interesting philosophically, if someone has something new to say. It's an appeal to the logical extreme of post-modern relativism (and when we see logical extremes, I believe it's a good question to ask - is this a real problem or just philosophical). It also is misleading, IMHO, because it conflates morality, offensiveness, and power. Regardless, these kinds of philosophical arguments can be continued indefinitely, but so is the one that says the Internet is a figment of my imagination. I'm talking about reality. In reality, the human mind doesn't need and very rarely uses the extreme of hard and fast algorithms; we are not computers. I can judge good from bad, constructive from destructive, etc. and it is easy to identify most of the problematic comments. When it's a forum with rules, it's easy to identify (again, a wild guess) 95% of them.
- intended 6y agoNo? I’ll argue that the main product of reddit is not the community, its the content moderation. Maybe eventually the content moderation toolkit. At this point reddit mods and users must have collectively built the largest collection of regexes to identify hate/harmful speech For a huge number of sub cultures.
- jonnycomputer 6y agoA system that limits the number of posts individuals can make on a per-article or per-diem basis would go a long way to silencing overly strident voices which, out of their sheer verbosity and pertinacity make it appear that their (often) extreme views are more prevalent and widely accepted than they in fact are. An alternative is to generate an in-forum currency that can be spent on comments, either on a per-post or per-word basis. This currency could be earned based on reputation--but as we see here on HN, and many other places, upvotes does not always go to the most thoughtful and engaging comments--or some other metric (statistical distinguish-ability of posts from the corpus of posts? not sure).
- dredmorbius 6y agoSybil problem. Per-account limits don't apply to those with unlimited accounts. Some form of payment (or hash cash) is an option, but hugely favours those with the ability of those who can pay (or hash). This correlates strongly with current sources of disinformation.
- 6510 6y ago> Microsoft made it much harder to do bad stuff, and wrote software to look for bad stuff. Before MS there was no bad stuff on the commodore 64. It just didn't exist. Loading things from tapes, disks or the internet doesn't matter. You switch it off and on again then load the next thing. I see no reason why this cant scale. You would have problems if you allow unchecked io and remote code execution and you would have to deal with that but even then a simple reset would clean it up. There is no need to give strangers the keys to your home and offer them a place to hide where you cant find them. > Virus scanners and content moderation are essentially the same thing - they look for people abusing the system The problem is that it is not your page. This forces you to live up to someone else's standards (if not forein laws) It is like the PC architecture where the computer is not yours. Facebook is really what web standards should have offered. I would probably have been against it myself but in hindsight it is what people really wanted. >...content moderation is a Sisyphean task, where we can certainly reduce the problem, but almost by definition cannot solve it. I don't know, perhaps we can. Should we want to? > I wonder how differently newsfeeds and sharing will work in 5 years Ill still be using RSS and Atom.
- contextfree 6y agoDon't you have a potential malware problem as soon as sharing data between apps (i.e., having a hard disk with a persistent file system which multiple apps can access, even if serially/one at a time) becomes commonplace? Hard disks with persistent filesystems seem awfully useful. as a nitpick, C64 wasn't really "before MS" - it booted to a BASIC which was derived from Microsoft BASIC!
- 6510 6y agoI'm oversimplifying. Basically, I switch on the c64, insert a floppy, load a program and get exactly that. The floppies are physically separated. Without physical access the application can't write to its own floppy[0] Say you physically contain each app by giving it its own processor and its own memory/storage. If it wants access to anything else it needs specific permission managed by something baked onto a chip. A complex detailed permission system. You don't just get to read keyboard input but if you do you don't just get to read it when the application is not focused. If an application is registered to work with a file type it can have access to those but only in defined locations and only that file type, reading and writing separately. If it wants access to anything outside its scope of permission the user not the developer can pick what permission is to be granted and for how long. Add 2 mechanical switches that make it physically impossible to write to and/or read a drive. It seems annoying and bureaucratic but it would allow us to download and run any code from the internet which would be truly exciting. Right now I cant even plug in an usb device and when I do there is no way of knowing what happens to it. It seems absurd. [0] - https://www.researchgate.net/profile/Stephen-Cobb-4/publication/285927161/figure/fig19/AS:421650417098756@1477540701571/Write-protection-on-floppy-disks.png https://www.researchgate.net/profile/Stephen-Cobb-4/publicat...
- _carbyau_ 6y agoUh, I gave up reading from here: "On an iPhone, an app can’t run in the background, watch what you do, and steal your bank details, because the move to a sandboxed model means applications can’t run in the background and watch what you do." Maybe that applies to iPhones but Android certainly allows it.
- crazygringo 6y agoThe quote literally says it's regarding iPhones. Why would you stop reading after a true statement about iPhones...?
- aaroninsf 6y agoSome intertwined problems, which we mostly try to nervously look away from in this forum/industry/epoch: - (effectively all) humans are first of all impulsive, driven by emotion and tribal identity, and most of all, subject to cognitive errors and for that reason and others, predictably effective manipulation - the tools/practices for such manipulation, which many on HN are actively advancing because yaaay $$$, are now so powerful as to in aggregate overwhelm all current defenses (including good intentions, individual discernment, and various technical solutions ITT) - the financial/power incentives to abuse such tools and short circuit, bypass, block, subvert, etc., attempts to defend against these tools are overwhelming Look at the news cycle, for the 99th time the intersection of Facebook's utter sociopathology and the utter toothlessness of its sham oversight board and nominal internal protocols and standards is headline news. I got 99 problems, and stochastic mind control is one of em The only thing remotely effective is total deplatforming, and yeah, that's not the sharpest or most popular tool. Left hook climate change Right hook surveillance capitalism DOWN WE ALLLLL GOOOOOOOO
- dan-robertson 6y agoI wonder how well somethingawful-style signup fees solve this problem: pay $10 to sign up and if the platform doesn’t like your behaviour they can ban you or set you back to the pre-payment stage. This then somewhat disincentivises bad behaviour and, in particular, repeated or automated bad behaviour. Surely this would harm growth and it doesn’t feel like you’d have success charging a smaller fee in poorer countries. It could also be a recipient for being very unpopular with your users whenever they get punished. And I would worry that it would just incentivise spammers to steal credentials.
- Sohcahtoa82 6y agoIt also means that people with large amounts of disposable income can get away with not following the rules.
- dan-robertson 6y agoYeah this is definitely true but hopefully their repeated payments would help to offset that cost. And maybe some kind of ip or email based banning or account flagging could make moderation easier or account recreation more inconvenient.
- Tiktaalik 6y agoSA does eventually permaban people
- etblg 6y agoThere's a guy called Seraph84 who is already permaban'd, multiple times a month he will buy new accounts, make one or two posts on each, get immediately permaban'd again, and repeat this process. So it's not a foolproof system, but at-least it can help keep the lights on for people who are terminally online (unless they do CC chargebacks).
- wilg 6y agoWe're working on a social tool (maybe not a network?) that we want to be funded by users instead of ads and we're thinking that as you say a fee may help discourage automated spam. Also we're finding that some of the features that enhance user privacy could help reduce bad behavior, like defaulting to smaller, closed groups of people. But it's a fascinating challenge and there's so many facets to it – glad people are starting to think about different ways to approach the problems with social! (Sneaky pitch: if this sounds interesting to you maybe let's work together! https://frenlo.com/ https://frenlo.com/)
- riskneutral 6y ago> we require seat belts and safety standards, and speed limits, but don’t demand that cars be unable to exceed the speed limit. That isn't how cars generally work. Without advanced electronic controls, it's not possible to build a car that can't exceed the speed limit. You can try to limit the acceleration but not the speed. It's basic physics. It's worrying that the author used it as an analogy (metaphor?) but doesn't seem to wonder why cars really don't have speed limits.
- edrxty 6y agoIt's actually pretty trivial to build a mechanical governor and they have existed for hundreds of years [1] Everything comes down to political will. The German manufacturers have an informal agreement to limit all their cars to 155mph as to avoid the government adding further limits to the autobahn. [1] https://en.wikipedia.org/wiki/Centrifugal_governor https://en.wikipedia.org/wiki/Centrifugal_governor
- Tiktaalik 6y ago> we have to decide what we want, just as we did for cars or telephones - we require seat belts and safety standards, and speed limits, but don’t demand that cars be unable to exceed the speed limit. off topic but, yikes, what a bad analogy. Considering the fact that motor vehicle crashes are the leading cause of death for children, young people, and unnatural death in general I dunno if one should compare anything positively to our society's decision to embrace the car. Accepting the insane deaths, dangers and terrible second order effects deriving from car oriented infrastructure and then just shrugging because of convenience has been one of the most misguided policy mistakes of the 20th century.
- dolni 6y agoYou've definitely run with the most negative take on the automobile here. Being able to travel with ease enriches lives in so many ways. It's been an absolute disaster for the environment, and safety is not great, as you say. But I don't think it's as cut and dry as you make it.
- edrxty 6y agoAgreed, if that logic is applied with the same intensity everywhere, the world would be painfully bland. Obviously we've made some mistakes and possibly have gone too far in one direction on that axis, but particularly with regard to personal safety, people need to be willing to draw a line as to what is "good enough". Cars at this point are extremely safe by any reasonable metric, even if the absolute totals feel large.
- Tiktaalik 6y agoI feel like I'm taking crazy pills here. Cars are not safe. They're the number one killer. In contrast, how many people are killed by the automobile alternatives of cycling, public transit? Seems that those are safe to me.
- edrxty 6y agoSomething will always be the number one killer. Doesn't mean it isn't safe.
- Tiktaalik 6y ago> ...the answers to our problems with social media are not more moderators, just as the answer to PC security was not virus scanners, but to change the model - to remove whole layers of mechanics that enable abuse. So, for example, Instagram doesn’t have links, and Clubhouse doesn’t have replies, quotes or screenshots. This is effectively already what many newspapers do in disabling commentary on certain articles. I often notice this on the CBC that whenever there's any article about indigenous people posted, comments will be disabled to prevent incredible amounts of racism.
- monkeydreams 6y agoThe problem I have with Benedict Evans' commentary is that he is very quick to suggest that a proposed solution is wrong (especially if it impacts the FAANG execs who hang on his every word), but never offers up an alternative OR admits that a current solution might be better than no solution at all. Yes content moderation is not a scalable solution but no content moderation is far worse. I get it, the platforms are his bread-and-butter, but at some point he needs to stop pooh-poohing the solutions others are putting up and, you know, actually suggest a solution himself. In this article he presents the possiblity that moderation does not work in scale, and that we should stop pushing for it. Then what? Well, Benedict doesn't get into that. He suggests that change might be necessary and that it might be a complete change to a different model of interaction - but he stops short of suggesting that is might be up to the platforms (or the government) to enact that change. If he were to turn around and say "Twitter, you need to fix your shit. Stop allowing unlimited retweets of some poor shmuck's bad day tweet" then he would actually have a position worth considering. Edit: Changed the last line because I got distracted when writing the original and forgot to finish it.
- bryanrasmussen 6y agothere is the possibility with lots of problems that there are no solutions that will work, as you point out that does not mean one should not continue to try. The analogy might be that there is no solution to the problem of the mortality, but there are quite a few ways you can work to keep from dying of a heart attack in your 40s.
- betwixthewires 6y agoSorry dude that wrote this article, but it is a bunch of words saying nothing. No conclusion, just a bunch of bad comparisons and analogies. This sentence distils the article entirely: > an app can’t run in the background, watch what you do, and steal your bank details, because the move to a sandboxed model means applications can’t run in the background and watch what you do. It can't because it can't. Got it. To talk about the topic in the title though, content moderation is a dead end, not because of the need to do it, but because people will not tolerate it. Nobody has a monopoly on information sharing on the internet, no amount of justification will get people to sit and allow it. All moderation is good for is keeping your community on focus, trying to prevent any ideas, even bad ideas, from bring shared is a bad idea in itself. It is a dead end not because it is an unsolveable problem, there's a deeper root here. It is a dead end because the people you're trying to moderate don't see a problem that needs a solution in the first place, and they're going to avoid your attempt at controlling their voices and the flow of information. And they should.