4 ms·
"Dhruv Khullar (@DhruvKhullar) is a doctor at NewYork-Presbyterian Hospital, an assistant professor in the departments of medicine and health care policy at Wei
by SolaceQuantum 8y ago
"Dhruv Khullar (@DhruvKhullar) is a doctor at NewYork-Presbyterian Hospital, an assistant professor in the departments of medicine and health care policy at Weill Cornell Medicine, and director of policy dissemination at the Physicians Foundation Center for the Study of Physician Practice and Leadership."
OK. Also noted that this is an opinion piece and not journalism.
From the opinion piece:
"A recent study found that some facial recognition programs incorrectly classify less than 1 percent of light-skinned men but more than one-third of dark-skinned women. "
Study link:
http://news.mit.edu/2018/study-finds-gender-skin-type-bias-artificial-intelligence-systems-0212?mod=article_inline http://news.mit.edu/2018/study-finds-gender-skin-type-bias-a...
Exact stats:
"In the researchers’ experiments, the three programs’ error rates in determining the gender of light-skinned men were never worse than 0.8 percent. For darker-skinned women, however, the error rates ballooned — to more than 20 percent in one case and more than 34 percent in the other two."
From the NYT opinion piece:
"A.I. programs used to help judges predict which criminals are most likely to reoffend have shown troubling racial biases, as have those designed to help child protective services decide which calls require further investigation."
Associated links:
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing https://www.propublica.org/article/machine-bias-risk-assessm...
https://www.nytimes.com/2018/01/02/magazine/can-an-algorithm-tell-when-kids-are-in-danger.html?module=inline https://www.nytimes.com/2018/01/02/magazine/can-an-algorithm...
Relevant quotes from each:
"The formula was particularly likely to falsely flag black defendants as future criminals, wrongly labeling them this way at almost twice the rate as white defendants."
"48 percent of the lowest-risk families were being screened in, while 27 percent of the highest-risk families were being screened out. Of the 18 calls to C.Y.F. between 2010 and 2014 in which a child was later killed or gravely injured as a result of parental maltreatment, eight cases, or 44 percent, had been screened out as not worth investigation."
- gbrown 8y agoIt blows my mind that anyone thinks AI for recidivism is a good idea, given the well documented biases inherent in the existing system.