3 ms·

So problem here is no one will define a group, and a system will not automatically say if religion = foo then bar. Things will just statistically start going th

So problem here is no one will define a group, and a system will not automatically say if religion = foo then bar. Things will just statistically start going this way. Might not even be negative bias. If people with college degrees start appearing as less likely to commit fraud, then it might become biased toward degrees, discriminating against those who truly need help.

eesmith 2y ago
You've just discovered why people want to collect as much data and throw supposedly neutral algorithms like AI at it to find patterns. Problem is, the selection of which information to put into the model is biased. Like, why is religion even in there in the first place? What counts as a religion? Is "Christian" a category? Which makes a religion Christian? Can an atheist also be a Christian? ("Two per cent of Anglican priests don't believe in God, survey finds", https://www.independent.co.uk/news/uk/home-news/survey-finds-2-of-anglican-priests-are-not-believers-9821899.html https://www.independent.co.uk/news/uk/home-news/survey-finds... ) Does "college degree" distinguish between accredited and non-accredited colleges? If yes, from which accrediting organizations? If no, then from every diploma mill? For that matter, do honorary degrees count? Once we've seen the correlation that terrorists are significantly more likely to be engineers (https://duckduckgo.com/?t=ffab&q=why+are+terrorists+engineers&ia=web https://duckduckgo.com/?t=ffab&q=why+are+terrorists+engineer... ) ... what next? As to "who truly need help", we can look to how standardized tests are used to identify schools which aren't doing well. So, do we help them? Or sanction them and even shut them down? That's a political discussion, not one left to AI.