3 ms·
> The term "bias" leads you to believe the algorithms are generating results unrepresentative of wider reality, which simply isn't the case. But unlike the loa
by notahacker 10y ago
> The term "bias" leads you to believe the algorithms are generating results unrepresentative of wider reality, which simply isn't the case.
But unlike the loan example they are; that's precisely my point. In the loan example the algorithms (or actuaries' calculations) are often entirely accurate in identifying that for whatever reason $ISBLACK is associated with statistically significant increased likelihood of default after controlling for other variables, which may result in an unbiased estimation model assessing a particular person falls into an unacceptable default risk category (which FWIW isn't the same thing as accurately predicting a particular person won't pay, which is a more dangerous conflation of concepts...)
That doesn't apply to the examples discussed in the article - where Asians aren't blinking (or statistically more likely to be blinking), people trying to game a Twitter bot's corpus of conversations are not representative of human interaction patterns, nobody seriously believes social media bubbles represent reality and even the very important recidivism risk model is 50% more likely to be a false positive if a suspected repeat offender is black, and less likely to be a false negative if the individual categorised as low risk is white.
- AnthonyMouse 10y ago> even the very important recidivism risk model is 50% more likely to be a false positive if a suspected repeat offender is black, and less likely to be a false negative if the individual categorised as low risk is white. That's actually the expected consequence of having different recidivism rates. If some of the predictions of who will recidivate are wrong at random and a higher percentage of black people were predicted to recidivate then a higher percentage of black people will have been incorrectly predicted to recidivate. If some of the predictions of who won't recidivate are wrong at random and a higher percentage of white people were predicted not to recidivate then a higher percentage of white people will have been incorrectly predicted not to recidivate. In other words, X * error rate is more than Y * error rate because X is more than Y.