4 ms·
It's funny how racial bias always comes out in discussion about NN. It all depends on the training data and that's all there is to it. Yet somehow, some people
by Nydhal 10y ago
It's funny how racial bias always comes out in discussion about NN. It all depends on the training data and that's all there is to it. Yet somehow, some people tend to blame the models or the programmers for not correcting this "bias" that is not "supposed" to be there.
- deleted 10y ago[deleted]
- wonnage 10y agoIf the output of your fancy new NN classifies black people as gorillas it's absolutely the programmers' fault. It is useless for a large swathe of humanity, it creates a PR nightmare, etc. So nah, it's not funny.
- jclos 10y agoIt depends on how you define "programmers' fault". In this case it would more a case of needing more training data to correct the mistake, which may or may not be the programmer's fault.
- Manishearth 10y agoOf course it can be the programmer's fault. Programming NNs is not just about picking an unbiased sample set of data, you need to help the NN know what it's looking for. As I've explained in https://news.ycombinator.com/item?id=12759089 https://news.ycombinator.com/item?id=12759089, different races have different sets of facial features which are used for facial recognition (because they vary more). Now, when programming the NN, what if you only told it to look for the set of facial features you thought was important? It's very easy to let unconscious biases seep into your code.
- gotchange 10y ago> different races have different sets of facial features which are used for facial recognition I thought that «race» is a social construct not a scientific one and thus can't be relied on as a deciding factor in a scientific experiment or endeavor like face detection.
- Manishearth 10y agoI'm using the term broadly. Google Scholar search "cross race facial recognition" if you want scientific references on this. Or see https://en.wikipedia.org/wiki/Cross-race_effect#References https://en.wikipedia.org/wiki/Cross-race_effect#References
- gotchange 10y agoThat's the first sentence of the Wiki article: "The cross-race effect (sometimes called cross-race bias, other-race bias or own-race bias) refers to the tendency to more easily recognize members of one's own race." This premise is not well grounded in facts as evidence can show that some people esp. racially unaware, uneducated or desensitized don't fall into this category. To support their claim, they cite a US-only study which can't be sufficient to extrapolate for all humanity as a universal fact since we all know that US society is divided along racial line and it's deeply ingrained into people's minds from childhood. It's like their caste system and with a highly cultural not scientific element to it. Color me skeptic about this theory.
- rmc 10y agoHumans perceive and classify race. No-one's disagreeing on that. "Race is a social construct" means that it isn't based 100% on biology or genetics. Traffic laws are also social constructs. Yet we can build machines to follow them.
- gotchange 10y agoYeah, Humans perceive and classify race (accurately or inaccurately) and that's why it can't be a reliable indicator or cornerstone for any reliable scientific system esp. when taking into account the "fluid" or "conflicting" nature of some of the prevailing definitions of races out there.
- eeZah7Ux 10y ago> Humans perceive and classify race No. Some cultures on Earth define "race" with various, conflicting standards. Some don't even have that concept.
- radarsat1 10y ago"It all depends on the training data" Exactly.