3 ms·
I'm reminded of how Google images had an issue where dark skinned people sometimes turned up in a search for gorilla. 99.9% of the time, the image recognition
by robbrown451 7y ago
I'm reminded of how Google images had an issue where dark skinned people sometimes turned up in a search for gorilla. 99.9% of the time, the image recognition algorithm did really well, but here was a case where an error was really offensive. What was (probably) needed was for there to be a human that comes in and, not tag every gorilla image, but simply to give it some extra training around dark skinned humans and gorillas, or otherwise tweak some things specific to that sort of case, so the chance of it happening was reduced to nearly nothing.
There are probably a ton of situations like that in YouTube, where certain kinds of mistakes are hardly noticed (it shows you a video you weren't remotely interested in), but others can be really bad and need special training to avoid (such as where it shows violent or sexual content to someone who likes nursery rhymes and Peppa Pig).
- miemo 7y agoif a google employee suggested they check for AI confusing gorillas and black people, damore than likely be fired for thinking it up
- deanCommie 7y agoI sincerely hope you don't actually think that, and did it only for the pun
- doyoulikeworms 7y agoI mean, that's a pretty easy conversation to have, no? "Hey team, when I search for 'gorilla', black people come up instead. Here, look. That's a problem, right? So I'm going to file this JIRA..."
- krapp 7y agoExcept what would really happen is people insisting that there's no actual racism involved, because software cannot be racist, rather the purely technical and politically neutral fact that black people do (chromatically speaking) resemble gorillas more than white people, meaning the algorithm is correct to make the association. And once it was changed, people would complain that it's just another example of Google being run by extremist far-left ideologues who are ruining the meritocratic purity of tech with their social justice agenda.