3 ms·
Hm? At this point there's really nothing controversial about "racist data makes racist models" (I'm being flippant in my phrasing, but, more rigorously: "the mo
by serioussecurity 8y ago
Hm? At this point there's really nothing controversial about "racist data makes racist models" (I'm being flippant in my phrasing, but, more rigorously: "the model will reflect and reify the biases of the person training the model and the data used to train it, and the people who annotate the training data")
I like this: https://arxiv.org/abs/1706.09847 https://arxiv.org/abs/1706.09847
- salty_biscuits 8y agoBut the system in question is scanning a crowd looking for known faces in a database, race only enters it when you are comparing it to the human system of a police officer looking for terrorists at a football game. I get that people object to persistent surveillance but that doesn't seem to be what this system is about. It is looking for certain people at certain events. The way your face gets on the list in the first place is where you should put your concerns...
- godelski 8y agoWell what I was saying, and why I suggested hedging the accusation, is that if someone does, say an AI that determines court sentences then that might cause the AI to be racist even though race was never set as a parameter. Such an AI might have racist behavior because of the naivety of designer[1], not that the designer was themselves racist. Obviously the designer could make this data set racist on purpose, I was just saying that an AI that judges on race might be due to stupidity and not malice. Hanlon's Razor. [1]Not realizing that there are other parameters that correlate with race