4 ms·
I suspect what makes it different is the concentration to just the flagged is what turns it into especially traumatizing. Of course there is probably a bell cur
by Nasrudith 2y ago
I suspect what makes it different is the concentration to just the flagged is what turns it into especially traumatizing. Of course there is probably a bell curve of sorts for "experiences" vs "level of personal trauma". One incident might be enough for someone "weaker" to develop PTSD. Not a slight on the afflicted, just how things are.
Casual Facebook viewers may stumble across something disturbing on it, but they certainly don't get PTSD at the rate of the poor moderators. Likewise the professionals usually have their own professional exposure levels to messed up stuff. Meanwhile child pornography investigation departments who have to catalogue the evidence are notorious for suffering poor mental health even with heavy measures taken.
There is already the 'blacklist hash' approach to known bad images which can help reduce exposure. So they don't all need to be exposed to say the same cartel brutal execution video, the bot takes care of it. I don't know anything about Facebook's internal practices but I would presume they already are doing this or similar with their tech hiring base.
Dilution is likely the answer for how to make it more palitible and less traumatizing. Keep the really bad stuff exposure at similar proportions to what other careers experience. Not having 'report button' and 'checking popular content' as separate tasks and teams would probably help a little bit. I suspect the moderators wouldn't be as traumatized if they just had to click through trending posts all day. A dillution approach would still have to deal with the logistical trade-offs for what could be viable. Increasing the moderation payroll a hundred-fold and making them work at effectively 1% efficiency would make for better moderator experiences, but Facebook would be understandably reluctant to go from 5% revenue content moderation budget to 50% revenue content moderation.
- BehindBlueEyes 2y agoIs it even 5% of revenue? Curious where you got that number because it seems unbelievably high