3 ms·
Would depend on their personal relationship. Which is to say: Often it's not reasonable to act without first knowing if the recipient actually took offence or
by vidarh 5y ago
Would depend on their personal relationship.
Which is to say: Often it's not reasonable to act without first knowing if the recipient actually took offence or felt threatened, before even considering anything else, because you can't know. A model aimed at judging utterances needs to also take into account "how close is this group? could this be in-group language?" and it needs sufficient context to judge that. Even then it'll have huge potential for error.
Incidentally, a lot of this wouldn't be nearly as much of an issue if we could trust that these kinds of tools would be used appropriately. E.g. instead of banning things, even just asking a "are you sure this will be taken the right way?" or similar is a whole lot more benign. The dating app Bumble uses a filter that checks for possibly explicit pictures, for example, but instead of blocking them it shows you a short message asking if you're sure the recipient wants to receive what you're sending, and lets you choose. Depending on use there might well be several levels of severity in messaging justified, from just a mild "are you sure?" marker to forcing you to explicitly acknowledge that you're on notice that you're responsible for the content.