4 ms·
I'm not trying to refute the problem of biased AI data, but I do want to understand it better. You mention an "insurance policy AI". The rest of this thread se
by skrebbel 6y ago
I'm not trying to refute the problem of biased AI data, but I do want to understand it better.
You mention an "insurance policy AI". The rest of this thread seems to be about image recognition. What's an insurance policy AI and how does it work? Is it a thing or a hypothetical future thing?
Can bias effects have equally bad effects in image recognition? I know about the story of the photo software that categorized a man's holiday photos under "gorillas" because it was trained only on white people. This is terribly insulting, but less terrible than an insurance company unfairly overcharging you or refusing you service.
I guess what I'm saying is I can't come up with biased image recognition AIs having unfair outcomes that actually affect people deeply, and I'm likely missing lots of terrible examples, and I'd love if someone can educate me.
EDIT: before people erupt in outrage, I'm not saying that a computer telling you that you're a gorilla isn't terrible, but in the end it's an indictment of the software, not you.
- whynaut 6y agoIf that software can’t distinguish a black man from a gorilla, i’m sure it’ll have trouble distinguishing two black men at least some of the time.
- lanstin 6y agoPulling people for extra checks in a security screening use case (from an image get an emotional state rating). Not hitting pedestrians in a self driving car. Also a lot of image scanning applications are being sold as “upload a photo of a prospective employee and a get a trust worthiness rating”.