3 ms·

Well, if "Please dont kill yourself" triggered the "kill yourself" algorithm, that might be a problem too.

• Cthulhu_ 4y ago
  An automated moderation system should be smart enough to detect sympathy. And if it's in doubt, it should leave it to a person - a native speaker of the given language, because a lot of these systems are trained on English and western language and sentiments.
  • bmacho 4y ago
    "Please don't kill yourself" can mean "kill yourself" depending of the original post and poster.
  • hotpotamus 4y ago
    I know that my comment is a trivial observation, but an automated moderation system capable of detecting sympathy sounds like science fiction. Frankly it seems like humans struggle at it.
  • tablespoon 4y ago
    > An automated moderation system should be smart enough to detect sympathy. That sounds like a super hard natural language understanding task. > And if it's in doubt, it should leave it to a person - a native speaker of the given language, because a lot of these systems are trained on English and western language and sentiments. That costs lots of money that could be going to the shareholders or executive compensation instead.
    • anticensor 4y ago
      What if shareholders themselves are tasked to do that stuff?