3 ms·

(I feel dirty asking this question, btw, but it's the first thing that came to mind when considering the GP's points.) How do you see the system handling someo

(I feel dirty asking this question, btw, but it's the first thing that came to mind when considering the GP's points.) How do you see the system handling someone's answer to "What are you worried about?" being something like "My dad's been raping me for years but I'm worried that if I tell someone he'll get into trouble and we won't be able to carry on paying for my mom's medicine and she will die"? That could either be someone in really difficult circumstances, or someone who is trolling others to upset them - there's no way to know from one message. If you shadow-ban the person in difficult circumstances it's not very kind, but if you let the troll through (with identical words), whoever reads it may have an awful day agonising over how to respond. I wouldn't call something like that toxicity, because it might be genuine distress.

andrewthebold 7y ago
I think there's better scaffolding/explaining to do with content guidelines and expectations, but the general idea is that content that causes concern like this should be reported. A lot of explicit content would probably already be caught by a filter for manual review. It would be taken down and I would send a message to the writer with mental health or counseling resources (ex: crisis text line). I take all messages seriously by default, even if it appears to be trolling. If that person continued to write content like that, I'd do a bit more digging. This is where it'd be subjectively up to me as the moderator to take action. Banning or shadow-banning would be a last resort, generally. There's no strong accountability on my end (beyond people not using the app), but I'm interested in creating a system people can trust. If the app continues to gain traction, I'm thinking about writing formal moderation rules and expectations and seek input from the community. If you have any ideas, I'm eager to listen!

andrewthebold 7y ago

I think there's better scaffolding/explaining to do with content guidelines and expectations, but the general idea is that content that causes concern like this should be reported. A lot of explicit content would probably already be caught by a filter for manual review. It would be taken down and I would send a message to the writer with mental health or counseling resources (ex: crisis text line). I take all messages seriously by default, even if it appears to be trolling. If that person continued to write content like that, I'd do a bit more digging. This is where it'd be subjectively up to me as the moderator to take action. Banning or shadow-banning would be a last resort, generally. There's no strong accountability on my end (beyond people not using the app), but I'm interested in creating a system people can trust. If the app continues to gain traction, I'm thinking about writing formal moderation rules and expectations and seek input from the community. If you have any ideas, I'm eager to listen!