4 ms·

Quoting the paper, an example of this "terrible" implicit bias is associating men with programming and women with house keeping. What exactly does an AI that's

by hasenj 9y ago

Quoting the paper, an example of this "terrible" implicit bias is associating men with programming and women with house keeping. What exactly does an AI that's free from biases look like? Will it presume for instance, that all men and all women are the same, all the time? How is that AI at all? Correct me if I'm wrong, but I think the whole point of AI is to find patterns in the data that can help make decisions that lead to a desired outcome. If you're not using real real world data, are you really doing AI?

AstralStorm 9y ago
Artificial coin flipping. As they say, garbage in, garbage out. This is especially true in automated decision making. We do not want the system to actually make bad decisions for sake of equality right? Now if you want to debias datasets without hurting accuracy or decision results you really need a true superintelligence much better than human. (People are biased, more or less subtly. Bias is somewhat reduced by taking a weighted or flat average of opinions.)
rspeer 9y ago
AI is just a tool, a way to automate making more kinds of decisions. The decisions are not better or inherently more right by virtue of taking a human out of the loop. In fact, they're usually worse, because humans are intelligent for real and computers are not. But the decisions are automated, and that makes more things possible. And sometimes you need to deal with the effects of automation. Nobody could reasonably declare an AI "free from biases", but you can work on particular aspects. Here's an example: Meetup de-biases their recommender system so that it doesn't automatically recommend knitting instead of coding meetups if you are a woman. [1] Yes, in the data, there are relatively more women going to knitting meetups and fewer going to coding meetups, but it doesn't have to use that data or its correlates to make predictions. In fact, it shouldn't. If you do like knitting, it can still learn that from your actual personal preferences and not infer it bluntly from your gender. [1] https://civichall.org/civicist/meetup-counters-invisible-sexism/.WdflQbxqvIY.twitter https://civichall.org/civicist/meetup-counters-invisible-sex...
- hasenj 9y ago
  A little off topic but I find most recommendation systems to be abysmal failures. It's like, as soon as you look into something, they start assuming you're very interested in it, and they don't show recommendations for anything other than things related to what you've looked into before.

by hasenj 9y ago

AstralStorm 9y ago

Artificial coin flipping. As they say, garbage in, garbage out. This is especially true in automated decision making. We do not want the system to actually make bad decisions for sake of equality right? Now if you want to debias datasets without hurting accuracy or decision results you really need a true superintelligence much better than human. (People are biased, more or less subtly. Bias is somewhat reduced by taking a weighted or flat average of opinions.)

rspeer 9y ago

AI is just a tool, a way to automate making more kinds of decisions. The decisions are not better or inherently more right by virtue of taking a human out of the loop. In fact, they're usually worse, because humans are intelligent for real and computers are not. But the decisions are automated, and that makes more things possible. And sometimes you need to deal with the effects of automation. Nobody could reasonably declare an AI "free from biases", but you can work on particular aspects. Here's an example: Meetup de-biases their recommender system so that it doesn't automatically recommend knitting instead of coding meetups if you are a woman. [1] Yes, in the data, there are relatively more women going to knitting meetups and fewer going to coding meetups, but it doesn't have to use that data or its correlates to make predictions. In fact, it shouldn't. If you do like knitting, it can still learn that from your actual personal preferences and not infer it bluntly from your gender. [1] https://civichall.org/civicist/meetup-counters-invisible-sexism/.WdflQbxqvIY.twitter https://civichall.org/civicist/meetup-counters-invisible-sex...

hasenj 9y ago
A little off topic but I find most recommendation systems to be abysmal failures. It's like, as soon as you look into something, they start assuming you're very interested in it, and they don't show recommendations for anything other than things related to what you've looked into before.