6 ms·

ImageNet Roulette

60 points by polm23 7y ago

jacquesm 7y ago
I think they are going to be for an - unpleasant - surprise if this hits mainstream. And not on account of having too little bandwidth but because people will most likely think it is fun to expose themselves.
- nurettin 7y ago
  I was thinking of adding an online gallery for a friend's game and had the exact same thought. Something bad is bound to happen at some point. I even considered making it +18 to avoid any problems.
ptah 7y ago
it would be great if you can get a URL for your submission for sharing purposes
dpflan 7y ago
ImageRouleNette
minimaxir 7y ago
There has been media backlash because this app can output blatantly racist class predictions; classes that were present in the original ImageNet dataset, which this project was intended to highlight. It went horribly right. https://www.buzzfeednews.com/article/ryanhatesthis/heres-how-that-weird-face-app-everyone-is-using-works https://www.buzzfeednews.com/article/ryanhatesthis/heres-how...
- im3w1l 7y ago
  What needs to be done to fix it? Enough to rename the classes or does it go deeper than that?
  - GTP 7y ago
    There are also other problems than the name of the classes: the same person can be classified in very different ways if you provide photos where that person has different poses.
  - yorwba 7y ago
    Don't classify things into categories that aren't relevant to your application.
  - IfOnlyYouKnew 7y ago
    "It reveals the deep problems with classifying humans — be it race, gender, emotions or characteristics. It's politics all the way down, and there's no simple way to 'debias' it."
jszymborski 7y ago
It recognised Chuck Schumer as an "appointee" which is correct (I guess), but Nancy Pelosi as a member of an "extinct North American Indian people" Prediction: https://i.imgur.com/v66bHVM.png https://i.imgur.com/v66bHVM.png Source: https://i.imgur.com/v236tmA.jpg https://i.imgur.com/v236tmA.jpg
- pard68 7y ago
  I guess it thought it was a picture of Elizabeth Warren.
- IfOnlyYouKnew 7y ago
  Schumer really is "elected" more than "appointed". Even in his role as Minority Leader, which is somewhat secondary to being a Senator, it's an election that puts him there. The lowest class in this particular hierarchy are employees. The difference between the two can be significant, especially in matters of protocol. And the results can be surprising: On some seating charts, a small town mayor (elected) may get a better spot than the Chairman of the Joint Chiefs (Appointee), or the Director of the Fish and Wildlife service (appointee) is mentioned before a senior advisor (employee).
- Bluecobra 7y ago
  It classified Sam Smith as a rape suspect when his head is cropped, but the full image classifies him as a non-smoker... poor Sam. Prediction: https://imgur.com/a/KooOsjR https://imgur.com/a/KooOsjR Source: https://imgur.com/a/htjSKnB https://imgur.com/a/htjSKnB Prediction: https://imgur.com/a/wvIpEnC https://imgur.com/a/wvIpEnC Source: https://imgur.com/a/QPRyjh2 https://imgur.com/a/QPRyjh2
fhennig 7y ago
I think this is a cool art project to raise awareness for the worrisome side of classifications like that. I'd be interested to see how it is set up at the exhibition at the moment.
deleted 7y ago
[deleted]
gwd 7y ago
I can't figure out where some of these labels are supposed to come from. I uploaded a photo and got one label, "assenter" -- i.e., a person who assents; and another one, "psycholinquist". Does ImageNet actually have photos of human beings labelled "assenter" and "psycholinquist"?
- tveita 7y ago
  ImageNet is basically made by doing Google image searches on words from the WordNet database (a structured collection of words and their definitions), and then doing quality control by crowdsourcing. So from Googling "assenter" and asking a bunch of people "here is the definition of an assenter, does this image contain one?", they have 126 confirmed pictures of assenters that can be used to see what a typical assenter looks like. Then the data is used to train a neural network to recognise these classes. Some of these steps may introduce biases.
ryanmarsh 7y ago
I’m labeled a creep, and a white supremacist. Perhaps because I’m bald? Thanks ImageNet. It labeled my five year old daughter as a negotiator, so it’s not totally wrong.
- deleted 7y ago
  [deleted]
TrinaryWorksToo 7y ago
I submitted a photo of Martin Luther King Jr: https://www.biography.com/.image/ar_1:1%2Cc_fill%2Ccs_srgb%2Cg_face%2Cq_auto:good%2Cw_300/MTE5NTU2MzE2MjgwNDg5NDgz/martin-luther-king-jr-9365086-2-402.jpg https://www.biography.com/.image/ar_1:1%2Cc_fill%2Ccs_srgb%2... And got traitor, treasonist: https://imgur.com/iWt1vFs https://imgur.com/iWt1vFs
- AstralStorm 7y ago
  I put in Keanu Reeves and got a sociologist. I wonder how you can pick out a sociologist by look...

60 points by polm23 7y ago

I think they are going to be for an - unpleasant - surprise if this hits mainstream. And not on account of having too little bandwidth but because people will most likely think it is fun to expose themselves.

nurettin 7y ago
I was thinking of adding an online gallery for a friend's game and had the exact same thought. Something bad is bound to happen at some point. I even considered making it +18 to avoid any problems.

ptah 7y ago

it would be great if you can get a URL for your submission for sharing purposes

dpflan 7y ago

ImageRouleNette

minimaxir 7y ago

There has been media backlash because this app can output blatantly racist class predictions; classes that were present in the original ImageNet dataset, which this project was intended to highlight. It went horribly right. https://www.buzzfeednews.com/article/ryanhatesthis/heres-how-that-weird-face-app-everyone-is-using-works https://www.buzzfeednews.com/article/ryanhatesthis/heres-how...

im3w1l 7y ago
What needs to be done to fix it? Enough to rename the classes or does it go deeper than that?
- GTP 7y ago
  There are also other problems than the name of the classes: the same person can be classified in very different ways if you provide photos where that person has different poses.
- yorwba 7y ago
  Don't classify things into categories that aren't relevant to your application.
- IfOnlyYouKnew 7y ago
  "It reveals the deep problems with classifying humans — be it race, gender, emotions or characteristics. It's politics all the way down, and there's no simple way to 'debias' it."

jszymborski 7y ago

It recognised Chuck Schumer as an "appointee" which is correct (I guess), but Nancy Pelosi as a member of an "extinct North American Indian people" Prediction: https://i.imgur.com/v66bHVM.png https://i.imgur.com/v66bHVM.png Source: https://i.imgur.com/v236tmA.jpg https://i.imgur.com/v236tmA.jpg

pard68 7y ago
I guess it thought it was a picture of Elizabeth Warren.
IfOnlyYouKnew 7y ago
Schumer really is "elected" more than "appointed". Even in his role as Minority Leader, which is somewhat secondary to being a Senator, it's an election that puts him there. The lowest class in this particular hierarchy are employees. The difference between the two can be significant, especially in matters of protocol. And the results can be surprising: On some seating charts, a small town mayor (elected) may get a better spot than the Chairman of the Joint Chiefs (Appointee), or the Director of the Fish and Wildlife service (appointee) is mentioned before a senior advisor (employee).
Bluecobra 7y ago
It classified Sam Smith as a rape suspect when his head is cropped, but the full image classifies him as a non-smoker... poor Sam. Prediction: https://imgur.com/a/KooOsjR https://imgur.com/a/KooOsjR Source: https://imgur.com/a/htjSKnB https://imgur.com/a/htjSKnB Prediction: https://imgur.com/a/wvIpEnC https://imgur.com/a/wvIpEnC Source: https://imgur.com/a/QPRyjh2 https://imgur.com/a/QPRyjh2

fhennig 7y ago

I think this is a cool art project to raise awareness for the worrisome side of classifications like that. I'd be interested to see how it is set up at the exhibition at the moment.

deleted 7y ago

[deleted]

gwd 7y ago

I can't figure out where some of these labels are supposed to come from. I uploaded a photo and got one label, "assenter" -- i.e., a person who assents; and another one, "psycholinquist". Does ImageNet actually have photos of human beings labelled "assenter" and "psycholinquist"?

tveita 7y ago
ImageNet is basically made by doing Google image searches on words from the WordNet database (a structured collection of words and their definitions), and then doing quality control by crowdsourcing. So from Googling "assenter" and asking a bunch of people "here is the definition of an assenter, does this image contain one?", they have 126 confirmed pictures of assenters that can be used to see what a typical assenter looks like. Then the data is used to train a neural network to recognise these classes. Some of these steps may introduce biases.

ryanmarsh 7y ago

I’m labeled a creep, and a white supremacist. Perhaps because I’m bald? Thanks ImageNet. It labeled my five year old daughter as a negotiator, so it’s not totally wrong.

deleted 7y ago
[deleted]

TrinaryWorksToo 7y ago

I submitted a photo of Martin Luther King Jr: https://www.biography.com/.image/ar_1:1%2Cc_fill%2Ccs_srgb%2Cg_face%2Cq_auto:good%2Cw_300/MTE5NTU2MzE2MjgwNDg5NDgz/martin-luther-king-jr-9365086-2-402.jpg https://www.biography.com/.image/ar_1:1%2Cc_fill%2Ccs_srgb%2... And got traitor, treasonist: https://imgur.com/iWt1vFs https://imgur.com/iWt1vFs

AstralStorm 7y ago
I put in Keanu Reeves and got a sociologist. I wonder how you can pick out a sociologist by look...