8 ms·
https://motherboard.vice.com/read/why-an-ai-judged-beauty-contest-picked-nearly-all-white-winners https://motherboard.vice.com/read/why-an-ai-judged-beauty-co..
by sp332 10y ago
https://motherboard.vice.com/read/why-an-ai-judged-beauty-contest-picked-nearly-all-white-winners https://motherboard.vice.com/read/why-an-ai-judged-beauty-co... “It happens to be that color does matter in machine vision,” Alex Zhavoronkov, chief science officer of Beauty.ai, wrote me in an email. “and for some population groups the data sets are lacking an adequate number of samples to be able to train the deep neural networks.”
- Houshalter 10y agoWell of course a beauty contest judged by AIs would go horribly wrong. Appearance is highly subjective and arbitrary. But even so it's not clear their algorithm was the cause of the bias, or that the bias was significant. For instance, it's possible that black people have slightly worse "facial symmetry" on average, or whatever made up metric they were using. And even if black people only scored 1% worse on average, that means the extremes will be dominated by whites, because of the way gaussian distributions work. So it may appear to be way more biased than it actually is.
- vintermann 10y agoEven with no bias, uncertainty can cause problems. Say an ML system is tasked with finding the top 10 candidates in terms of "confidence that they will be able to do the job". Then if it has little training data on candidates of a particular class, and those in that class are actually quite different on many different variables (so it can't generalize very well), it may not be able to reach the required levels of confidence for them. I think this is actually the reason for a lot of accidental discrimination, because human judges would have exactly the same problem. I remember in school, playing chess a couple of times against a guy fresh from Sudan. He had the most unsettling smile, and played very unorthodox openings. I won some, he won some - but I always suspected he was stronger than me, and just being polite/testing me. It's just impossible to read someone from a culture so different. I'm glad we didn't play poker, to put it like that.
- lqdc13 10y agoThat particular study is pretty bad. Look at the contestants' faces. They might be failing at identifying facial features or not accounting for lighting, tilt, etc. It is obvious if you look at their estimated ages.
- sp332 10y agoSorry but your knee-jerk "analysis" doesn't hold as much weight with me as the judgement of the program's actual authors.
- lqdc13 10y agoThey clearly got the ages wrong that's not really debatable. Do not take my word for it though. There are plenty of studies in this space that got wildly different results some of which mostly agree with hotornot ratings.