5 ms·
Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightnes
by scotty79 5y ago
Is that a result of a skewed training set or are people really hard to tell apart from gorillas if there are no obvious tells like large difference in brightness of different areas of the face?
- MattGaiser 5y agoI would be interested to know if young children would do much better in many cases. When I was quite young, I referred to some firefighters as robots.
- JasonFruit 5y agoIt reminds me of some of the explorers' tales of people who were half-human, half some other animal, or of people covered in hair, the first of which may have originated from seeing people riding animals, and the others to various (actual) primates. If humans can make such mistakes, certainly Facebook's AI can be excused for its confusion.
- MattGaiser 5y agoApparently we are not sure whether the original term Gorillai referred to people or gorillas. https://en.wikipedia.org/wiki/Gorilla#Etymology https://en.wikipedia.org/wiki/Gorilla#Etymology
- klyrs 5y agoAre you sure those were honest mistakes and not stories for the sake of storytelling? And no, prehistoric ignorance does not justify this system making it to production.
- deleted 5y ago[deleted]
- Barrin92 5y agothe biggest tell is probably that, unless the person is in a zoo, I haven't seen many gorillas at starbucks which says a lot about the state of our alleged human outperforming AI
- maweki 5y agoI don't know. I think I would not have a hard time picking out a gorilla at Starbucks. And I'd like to see a gorilla in any pose that's really hard (for a human) to differentiate from a person. The truth is: the recognition algorithm is not very sophisticated after all.
- epmaybe 5y agoIsn’t the latter a possible consequence of the former?
- not2b 5y agoSkewed training set, very few dark skinned human faces.
- missedthecue 5y agoThe training set had more primates than dark skinned humans? Unlikely.
- exporectomy 5y agoGot a source for that?
- jdavis703 5y agoI’m not an expert in this field. What are the likely root causes for this happening?
- SilverRed 5y agoThe most obvious answer that no one wants to mention is that there just genuinely is some similarity between the two categories which is stronger than the similarity between others.
- not2b 5y agoWhile I don't have a source, it seems clear that with sufficient training data they could do better at avoiding this mistake. This should not be hard.
- exporectomy 5y agoPerfect accuracy in image classification is an unsolved problem. So yea, it's hard.
- SilverRed 5y agoIf Google and Facebook have both failed with the billions they have spent on the problem, I think we can say yes, it is that hard. Obviously the people at google had thought of having more training data.
- exporectomy 5y agoGorillas have black and human-like faces. I think they're just quite similar so AI can more easily confuse them.
- hnick 5y agoNow you've made me wonder what it thinks about albino gorillas. e: I assume something similar has been done before by training a model on brown/black bears then throwing polar bears at it. Anyone know the outcome?
- sluggosaurus 5y ago> Gorillas have black and human-like faces. Chimpanzees often have 'white' and human-life faces. Are these algorithms ever classifying white people as chimpanzees? https://en.wikipedia.org/wiki/Chimpanzee#/media/File:Chimpanzee_Ham_in_Biopack_Couch_for_MR-2_flight_MSFC-6100114.jpg https://en.wikipedia.org/wiki/Chimpanzee#/media/File:Chimpan...
- 0x426577617265 5y agoI’m fairly certain if you showed pictures of both groups to a toddler they’d be able to sort them correctly. It’s really not hard for a human to tell the difference. Which tells me that FB’s AI isn’t really that great.
- SilverRed 5y agoI saw another article which included a screenshot of the mistake on facebook. The photo is blurry, and contains a side view of the person and iirc the backdrop is in nature. The main indicator that it was a person was the fact they were wearing clothing. Clearly the AI is not good enough, but I will admit that the data it was working on is tricky to achieve perfect accuracy.
- 0x426577617265 5y agoThe article I saw with the screenshot was from NYTimes: https://www.nytimes.com/2021/09/03/technology/facebook-ai-race-primates.html https://www.nytimes.com/2021/09/03/technology/facebook-ai-ra...
- civilized 5y agoDeep learning, for all its recent glories, still suffers from relatively crude, slow-converging training algorithms compared to other areas of ML and statistics. Maybe to your typical SGD-type algorithm, working off a dataset filled with mostly light skin toned people, skin tone just looks like a real solid first-order way to distinguish humans and primates, and picking up the black people / primate distinction seems much more marginal and second-order, in terms of impact on the cost function. If most of the people in the dataset were black, I predict you wouldn't see this.
- tomrod 5y agoConsider too what they are likely using for inputs: photos with associated comments. I don't know Facebook's TOS sufficiently to know whether they are using private groups as source material, but if you're utilizing bigoted content to train pattern recognition, you will replicate bigoted content.
- MathMonkeyMan 5y agoI wonder why this was downvoted. It's an interesting hypothesis.
- tcmart14 5y agoMy guess is that the poster was making an assumption that a large part of facebook's images are bigoted content. I am neither agreeing or disagreeing. But apparently some people got a little emotional about the platform being associated with maybe having a heightened amount of bigot content.
- tomrod 5y agoNot necessarily a large part, simply enough to identify as its own pattern. In my experience there are a lot of bigoted things on Facebook. If these are serving as source data, and are sufficiently distinguished from other training material, it may well be user behavior the ML system would replicate.
- jeromic 5y agoThere is evidence that CNN's use texture features more than shape features, i.e. have a texture bias. It's hard to tell in this case without access to the data/model, but it's very possible colour is being overvalued by the classifier and causes the errors.