4 ms·
It's not about intent at all, frequently in cases along the lines of "AI did racial profiling" the effect was entirely unintentional, it was the expression of a
by AndrewOMartin 8y ago
It's not about intent at all, frequently in cases along the lines of "AI did racial profiling" the effect was entirely unintentional, it was the expression of a bias in the data, or an unintended bias from the point of view of the developers.
- Ar-Curunir 8y agoYes, but when you seek your ML product as the panacea to all problems, you should be accountable for what it outputs but people don't want that; they want the ML to be viewed as something beyond human understanding, something omnipotent and all-seeing.
- dv_dt 8y agoWhich opens the door for people are all too willing to exploit that through real ML algo & data weaknesses.
- crooked-v 8y agoPeople can be, and often are, racist without being intentionally racist.
- thosakwe 8y agoThank you for this. This fact needed to be pointed out. (Edit: This wasn't sarcasm... Not sure why all the downvotes)
- getsugablitz2 8y agoNot one of the downvoters, but the general mindset is that if you thank someone and emphasize their comment, you should've just upvoted because you didn't really add anything to the thread.
- apeace 8y agoExactly. I wrote a relevant comment[1] on a different thread a while ago, which I'll reproduce here for convenience: The other day out of curiosity I was searching for basic words on ImageNet: cat, dog, man, woman. Here is the page for "woman" http://image-net.org/search?q=woman http://image-net.org/search?q=woman I was surprised to notice a couple of things: - There are categorizations for "mistress", "slut", and "adultress". The closest analogs for "man" appear to be "playboy", "stud", and "pimp". There is also a "foolish woman" and doesn't appear to be an analog for man. - Look at the pictures for "mistress". Many if not most of them are just women in their bathing suits or doing other normal things, like laying in a bed with a man. The same is true for "slut". Does this mean AIs using ImageNet could look at a woman on a beach and categorize her as a "slut"? - There is a category for "honest woman", which appears to be three pictures of a woman standing next to a man. I'm not saying anybody is at fault or that the people who put ImageNet together did this intentionally. After all, it does reflect the (unfortunate) reality of how our society often perceives images of women. But before I poked through that dataset, it wouldn't have occurred to me how important it is that we focus on equality and non-discrimination when it comes to AI. This declaration[2] seems like an interesting step. [1] https://news.ycombinator.com/item?id=17103921 https://news.ycombinator.com/item?id=17103921 [2] https://www.accessnow.org/the-toronto-declaration-protecting-the-rights-to-equality-and-non-discrimination-in-machine-learning-systems/ https://www.accessnow.org/the-toronto-declaration-protecting...
- weberc2 8y agoI don't know how much stock I would put in this being indicative of our society's views on gender. Notably, you point out that there is no male analog for "foolish woman", but we're all familiar with the foolish man trope (Joey from friends, Phil from Modern Family, Tim from Home Improvement, Ron Burgundy from Anchror Man, etc etc). Note: I shouldn't have to point out that I'm _not_ saying our society is fair and just with respect to gender, but I know a lot of people will try and twist my words, so hopefully this disclaimer heads off a lot of unnecessary tangents.
- crooked-v 8y agoIt makes me think less "failure in image classification", and more "implicit bias in the WordNet database and/or failure to represent concepts that can't be described succintly in English".