6 ms·
This may or may not be a useful technology, but the fact that Facebook thinks they have the ability and the right to diagnose their users with mental illnesses
by asdgkknio 9y ago
This may or may not be a useful technology, but the fact that Facebook thinks they have the ability and the right to diagnose their users with mental illnesses is disturbing. They have more information about their users than psychologists have about their patients. They can (and do) build a psychological profile and diagnose mental illness. Yet rather than keeping this information in the closest confidence, they sell it to the highest bidder. They can (and do) run experiments without getting informed consent (or any consent).
They're playing psychologist and should be subject to a similar code of ethics.
Another interesting article:
http://www.slate.com/articles/health_and_science/science/2014/06/facebook_unethical_experiment_it_made_news_feeds_happier_or_sadder_to_manipulate.html http://www.slate.com/articles/health_and_science/science/201...
- sjg007 9y agoInteresting.. I wonder if these profiles fall under HIPAA.
- crankylinuxuser 9y agoDoea medical data not talked about in a medical setting trigger HIPAA? (Like me talking that I'm type 2 diabetic?)
- deleted 9y ago[deleted]
- toomuchtodo 9y agoI can't speak to HIPAA, but medical data is covered by the EU's new GDPR framework.
- rosser 9y agoIf you talk about it outside a privileged context, you're implicitly waiving the privacy protections. For example, if you run into your physician in public, and say, "Hi Doc. Have you gotten my test results back yet?" you're the one pointing out that she's your doctor, not her. If she, unprompted, said something about your test results to you, she'd have violated HIPAA. It's your privacy to waive as you please.
- sjg007 9y agoProbably.. any disclosure could potentially be regulated. This is a company creating a health care profile of you (possibly without your consent) and potentially sharing that information of you (without your consent or release) to other entities.. so maybe? I bet there will be several lawsuits to clarify things.
- arkades 9y agoUnequivocally not. Posting to Facebook is a public disclosure Health data: no one, including your own physician, is obligated to protect that which you opt to publicly disclose.
- sjg007 9y agoWe are talking about a Facebook AI program reading your posts and deciding if you are suicidal or not. I'm not even sure how you would clinically validate that and if it would require FDA clearance, but if you are forming a mental health opinion on a stream of data and contacting the government about it that is probably something that may need to be protected.
- arkades 9y agoWhether or not one thinks it ought to be protected, there is no contortion of existing law that does so.
- sjg007 9y agoWell take a look at this: https://nakedsecurity.sophos.com/2013/07/05/can-facebook-updates-predict-suicide/ https://nakedsecurity.sophos.com/2013/07/05/can-facebook-upd...
- arkades 9y agoThe medical school structured itnas a clinical trial with people volunteering to participate. Medical studies have different regulations than just reviewing public postings. This is a reflection of the way they’ve chosen to go about things - no doubt in response to past kerfuffles - rather than an actual legal obligation on fb’s analysis of public materials. HIPAA regs aren’t hidden from the public. Peruse at your leisure.
- austincheney 9y agoAbsolutely not. HIPAA regulates the medical and insurance industries, which Facebook is certainly not. If you broadcast medical data to the public or put it in a newspaper HIPAA does not apply, much like this case. Best case scenario, and this is still a stretch, is that Facebook could be guilty of slander if they describe you has suicidal and that description becomes known to a third party without your consent.
- sjg007 9y agoI think it is unclear. For example Apple has HealthKit which collects health related data.. That data is probably HIPAA protected. If it's not (and if Facebook is not) then I would imagine we will see legislation and/or lawsuits to clarify things.
- dsp1234 9y agoApple is not a covered entity under HIPAA[0], and thus has no liability for the data it collects. "If an entity does not meet the definition of a covered entity or business associate, it does not have to comply with the HIPAA Rules." [0] - https://www.hhs.gov/hipaa/for-professionals/covered-entities/index.html https://www.hhs.gov/hipaa/for-professionals/covered-entities...
- sjg007 9y agoApple is most likely a business associate by definition.
- dajohnson89 9y ago>known to a third party without your consent. Sneaky suspicion: consent is given upon account registration.
- sjg007 9y agoMaybe, but I think health information disclosure has a lot of rules to it (at least based on my experience) where authorizations expire after 1 year etc... So I don't think a blanket exception applies. And although Facebook is a public forum not all communications are public per se so it's not clear what a disclosure is... maybe it is sufficient for Facebook to say that the information was "disclosed to us" and we are free to do what we want with it, including using an AI bot to alert emergency services. It seems like a big gray area.
- thg 9y ago> Yet rather than keeping this information in the closest confidence, they sell it to the highest bidder. https://arstechnica.com/information-technology/2017/05/facebook-helped-advertisers-target-teens-who-feel-worthless/ https://arstechnica.com/information-technology/2017/05/faceb...
- munificent 9y agoI'm sure advertisers of pharmaceutical companies can't wait to take advantage of this in their ad placement strategies.
- narrator 9y agoWhat would be cool is if someone could build a GAN based on the Facebook AI training set to spit out comments that would be indicative of certain moods. This capability would be great for autistic people trying to react appropriately in social situations... or an AI chatbot trying to act human.
- erasemus 9y agoI'm worried there's a taboo developing where only professionals or mentally ill people themselves are allowed to express any kind of opinion about mental illness or the mentally ill.
- alexanderstears 9y agoWell, let's be real you can hardly criticize someone without pathologizing it. In the 1970s, people were worried about kids reading comic books and garbage novels. In the 1980s-1990s, people were worried about kids playing too many video games or watching too much tv. Now we're worried about internet addiction as though kids get itchy and cold without their fix. We can't just say "don't spend 8 hours/day watching TV. Go outside" - we have to use the language of healthcare.
- timthelion 9y agoI'm worried that the field of psychology is gaining a monopoly on expression of feelings. We can no longer express happiness and sadness, anxiety and frustration, without being "diagnosed" in a horoscopic manner which has little or nothing to do with science and bears a great deal of stigma. The psychological disorders of today are the occult of yesterday. We believe that one can become possessed by depression or anxiety. Possessed by psychosis, possessed by a personality disorder, possessed by PTSD, possessed by a history of child abuse. And we have to call upon the psychologists to preform an exorcism.
- drb91 9y agoYou are free to reject diagnosis and medication unless you are determined a danger to yourself or others. HIPAA also gives you control over where your diagnoses travel. Not with facebook, of course, which doesn’t qualify for hipaa protections yet.
- timthelion 9y agoOf course you are free to do so, but back in the days of daemon possession, most people were just as free to reject the claim that they were possessed. What mattered back then, was not the claim though, what mattered back then was that ordinary people would look at someone and think "oh he's acting weird, he must be possessed". And that "possessed person" would then be feared. It interfered with the process of empathy.
- jsemrau 9y agoWhen I read this and realize that I am not on Facebook. This IS really disturbing and should be a huge red flag for all users.
- ProAm 9y agoGreat points, I wonder if FB actually employees psychologists and if so how many and what are their accreditations and level of professional experience.
- jacquesm 9y agoYes they do. Main mission: to make Facebook as sticky as possible.
- ProAm 9y agoIs there proof though? Id assume so, Im not sure psychologists follow a Hippocratic oath if they did this seems like it would cross a bit of a line, no?
- jacquesm 9y ago> Is there proof though? Just one google search away. Keywords such as Facebook, psychology, experiments, ethics will generate lots of interesting reading, some of it with good sourcing and links for further reading. It does for me, but there is always some excuse. Usually the mortgage or something to that effect.
- alangpierce 9y agoNot sure about full-time employees, but according to the video in https://www.facebook.com/safety/wellbeing/suicideprevention https://www.facebook.com/safety/wellbeing/suicideprevention, they work with suicide prevention groups and researchers.
- rdtsc 9y agoEven more, we've seen articles which pointed out how using Facebook makes people more depressed and doesn't help with isolation, and loneliness. So in a terribly ironic way, Facebook is making them depressed, but then it doesn't want to them to die because there's nobody left to lick the "Like" button, so it deploys AI doctors to diagnose and prevent suicide from happening.
- tomc1985 9y agoSounds like the old 'break their windows by night, fix em by day' trick
- eeZah7Ux 9y agoThis is really accurate. Keeping people depressed and addicted works for Facebook, in the alcohol industry, food, gambling and so on. And now a company with extremely powerful AI capabilities want to fine-tune the addiction algorithm to maximize profits.
- lostlogin 9y agoI get sick of screen touchers on a shared machine I use. This comment made me cringe.
- flashman 9y ago> Facebook thinks they have the ability and the right to diagnose their users with mental illnesses Maybe it's more that Facebook thinks it's horrible when people kill themselves, and that if Facebook's tech could help prevent suicide, inaction would be immoral. Most of us accept some level of State interference in our lives for our own good. Maybe we are going to have to have that discussion about involuntary interventions by corporations, too.
- asdgkknio 9y ago>Maybe it's more that Facebook thinks it's horrible when people kill themselves, and that if Facebook's tech could help prevent suicide, inaction would be immoral. That doesn't entirely contradict what I said. We generally assume psychologists and therapists are benevolent, but they aren't allowed to disclose private information even if it's in the best interests of the patient. Even if we assume Facebook is perfectly benevolent, this kind of vigilante psychology with no oversight is scary. They've thrown out all established codes of ethics in favor of just doing whatever the hell they want. And I'm certain Facebook isn't benevolent. They deliberately make their website as addictive as possible. They have run experiments that tried to make people unhappy. If this really is a selfless attempt to help their users, it's inconsistent with what Facebook has done before.
- BurningFrog 9y ago> They've thrown out all established codes of ethics They may have nudged on one particular code of ethics. Alarmism does not help your credibility.
- deleted 9y ago[deleted]
- glorkk 9y ago> Maybe it's more that Facebook thinks it's horrible when people kill themselves Of course! You can’t show ads to dead people...
- AlexandrB 9y ago
- threatofrain 9y agoI'd be curious if they were entertaining adverse hypotheses on mental health!
- drewmol 9y agoBy the way they elevate moderation priority for posts and FB Live, I pessimisticly assume their primary concern is to prevent people from committing suicide ON Facebook Live, which is much worse for Facebook than simply loosing users
- togg 9y agoWell if they don't have enough information to reach a diagnosis they can always head to the Zuckerberg San Francisco General Hospital.
- tw1010 9y agoAnd does it not seem likely that the output of this model would be used as a signal to influence the newsfeed algorithm? It's like a feedback machine showing already depressed people pictures of happy families, making them even more depressed, yet more hooked, eventually leading to you-know-what.
- alangpierce 9y ago> Facebook thinks they have the ability and the right to diagnose their users with mental illnesses Was this ever stated in the article? There's a big difference between diagnosing someone with mental illness and recognizing when someone is in a suicidal crisis. If someone is publicly saying things like "I wish I was dead" and "I'm going to kill myself" on Facebook, it seems highly ethical to automatically escalate to a moderator ASAP rather than waiting for someone to report it. If someone has a heart attack in the street, would you say "I'm not a doctor, so I don't have the ability or the right to diagnose what just happened"? No, you'd recognize that it's a serious emergency and find people who are able to help. This really isn't much different.