>It seems very unlikely that it would ever result in a situation where someone gets involuntarily hospitalized because some machine learning algorithm had a bug

>It seems very unlikely that it would ever result in a situation where someone gets involuntarily hospitalized because some machine learning algorithm had a bug. Perhaps, but people being involuntarily detained because people misunderstand communications those users thought to be private seems much more likely. I have a group of friends who share memes about suicide and make jokes about it constantly. This is actually pretty common. If some uninitiated outsider read some of my DMs, I’d expect some people I know to be on their way to hospital in handcuffs. More importantly, why does Facebook think this is their job, and why would anybody else agree with them about it? The idea of the postal service sending the police to my house because they were concerned about the contents of a letter I wrote is horrifying, or the phone company because they were worried about a call I had. I’m not any less horrified about facebook doing this, especially considering how much less I trust them than the postal service or Verizon.