On the flip side: A lot of claims of AI bias are overblown and/or straight-up disingenuous. Remember when ProPublica claimed that recidivism prediction models

On the flip side: A lot of claims of AI bias are overblown and/or straight-up disingenuous. Remember when ProPublica claimed that recidivism prediction models were biased against black people? (https://www.propublica.org/article/how-we-analyzed-the-compas-recidivism-algorithm https://www.propublica.org/article/how-we-analyzed-the-compa...) They rigged their analysis. There are two different fairness metrics - individual and group-based - that cannot possibly be fulfilled at the same time if there is any difference between the groups. (https://arxiv.org/abs/1609.05807v2 https://arxiv.org/abs/1609.05807v2) The model was fair all along according to individual metrics. ProPublica picked their fairness metric so as to make the model appear biased. The whole thing was a lie.