3 ms·
I still think racial profiling to flag suspicious cases is an example of discrimination. That's because the system more stringently checks people in one racial
by jawarner 6y ago
I still think racial profiling to flag suspicious cases is an example of discrimination. That's because the system more stringently checks people in one racial group for wrongdoing, which results in more of those people in the criminal justice pipeline.
As a concrete example of where this can go wrong, let's say that (hypothetically) 1% of people commit fraud, and that this prevalence is not correlated with race. But, due to past discriminatory practices, more people of one race than another are convicted of fraud. Then, this algorithm would perpetuate this discrimination, since, say, it would identify 80% of fraud in the discriminated group but only 50% of the non-discriminated group.
- sir_bearington 6y agoCorrect, and algorithm shouldn't use a protected class as an input. But at the same time, simply pointing out that a inequitable outcome is produced is not evidence of bias. Also, dual citizenship is not a protected class last time I checked.