4 ms·
The issue brought up by this moderator seems to match what we've heard and read from others, which puts Facebook, and sites like it, in an unfortunate position:
by mrweasel 6y ago
The issue brought up by this moderator seems to match what we've heard and read from others, which puts Facebook, and sites like it, in an unfortunate position: Content from a site like Facebook cannot be moderated without causing harm to human moderators, and A.I. is not yet able to do the job.
That's a massive issue as lawmakers are pushing for more moderation. It's my belief that Facebook, and others, have sold our politicians on the idea that moderation can be done, at scale, with AI. Those of us who followed along knows that the human moderators have complained that at least Facebooks A.I. simply isn't up to the task.
I don't think Facebook and similar sites can exist, not at that scale, without massive human cost.
- deleted 6y ago[deleted]
- mschuster91 6y ago> and A.I. is not yet able to do the job. AI won't be able to do the job until we manage to digitize brains. Stuff like sarcasm, irony, fair use or "dog whistling" (e.g. using "globalists" as a replacement for "jews") is something current AI's can't grasp at all, and even a digitized brain will struggle with these concepts - not to mention the ethical concerns that would come with digitizing a brain. Is it morally acceptable to torture a virtual brain that, in contrast to a human, can't even leave? To reset it to default state when it's too damaged?
- lalaithion 6y agoSee: https://moultano.wordpress.com/2019/10/02/why-do-companies-with-huge-resources-still-have-terrible-moderation/ https://moultano.wordpress.com/2019/10/02/why-do-companies-w...
- ceejayoz 6y agoHell, humans don't even understand sarcasm, irony, fair use, or dog whistling much of the time. Try submitting a dog whistle to Facebook's human moderators and it'll almost certainly get declined as within their standards. As a concrete example: "Congressman Falls for The Onion's Planned Parenthood 'Abortionplex' Story" https://www.theatlantic.com/national/archive/2012/02/congressman-falls-months-old-onion-story-about-planned-parenthood-abortionplex/332189/ https://www.theatlantic.com/national/archive/2012/02/congres...
- jka 6y agoIn the pursuit of creating a process that would be ethically challenging even for computers, we risk creating (have risked creating? have created?) processes that impose the same concerns on real people. Ostensibly so that we won't have to any more.
- intended 6y agoAgreed - Massive human cost. The sanitation and police workers of the internet being directly exposed to radiation. There is not free lunch. Side note = firms increasingly see their policy divisions as responding to government and political pressure, not content moderation. The next couple of years in the policy space are going to such for employees, as govts demand more power and oversight from SM firms.
- AdrianB1 6y agoWhy is more moderation asked for? The 1st is restricting the government to do it, so they are pushing private companies to do it? To what end goal? It does not make sense to me, but I don't know the political aspects of this.
- Nextgrid 6y ago> Content from a site like Facebook cannot be moderated without causing harm to human moderators, and A.I. is not yet able to do the job. It absolutely can - all you have to do is to discourage posting bad content in the first place by attaching actual consequences to breaking the rules. Things like restrictions on new accounts such as limits on posting links, media, number of posts, etc until the account slowly levels up its trust level. This would protect both against spam from new accounts (as they aren't able to do any significant damage) as well as incentivizes people to not break the rules as to not lose their "leveled up" account. This worked very well for a decade on various forums often run by volunteers with near-zero budget. The real problem is that unlike the forums of the good old days, Facebook's business model is not to provide a safe environment for quality discourse - instead it's to keep as many people "engaged" as possible - in this case banning rule-breakers is actually counter-productive, and is only done as a last-resort when their misdeeds are serious enough to become a PR risk for Facebook. Their complaints about moderation being impossible is a sleazy attempt to make people accept this and for bad content to eventually stop being a PR risk, thus theoretically allowing them to completely do away with moderation and still earn ad revenue from bad/criminal content.
- ericbarrett 6y agoFacebook absolutely does all the things you listed, and more; much more. While I agree that their incentives are often at odds with content enforcement, it is not a "just so" problem to be fixed with a better methodology or algorithm, and if you can think of it in an HN post I assure you they have already tried it in some fashion. P.S. Former Facebook employee
- SergeAx 6y agoML-backed automatic classification cannot solve 100% of problem, but it can do 90%-95% and left only tenative cases to humans. This combined with an easy human-reviewed appeal system and internal carma mechanics (even in the easiest form of reports/strikes/appeals/lost appeals stats) will reduce the problem 10-20-fold.