It should be blatantly obvious that is is, especially in cases where software is making actionable decisions. Is the software trained on sexist, ableist, racis

It should be blatantly obvious that is is, especially in cases where software is making actionable decisions. Is the software trained on sexist, ableist, racist, etc content that is illegal or deadly when applied to decisions? To answer that requires having the AI algorithm explain why its decision is as such. If we could see the explanation, we could either consider it or rule it out. https://www.technologyreview.com/2019/01/21/137783/algorithms-criminal-justice-ai/ https://www.technologyreview.com/2019/01/21/137783/algorithm... is one such software that was trained on racist data. Black people get harassed and sentenced more by police than others, and thus have strong bias in criminal data. This AI software was trained with that data, and thus perpetrates the same. https://becominghuman.ai/amazons-sexist-ai-recruiting-tool-how-did-it-go-so-wrong-e3d14816d98e https://becominghuman.ai/amazons-sexist-ai-recruiting-tool-h... Is a hiring AI that Amazon used - turns out when you don't hire many women, and train the AI on the data, it's very good at finding women's names to deselect from hiring. It's the same trend - poisoned prior data leads to future poisoned data at scale. https://abilitynet.org.uk/news-blogs/ai-making-captcha-increasingly-cruel-disabled-users https://abilitynet.org.uk/news-blogs/ai-making-captcha-incre... And this is for general internet users, primarily ones who have auditory or visual handicaps. CAPTCHAS are increasingly hostile to disabled peoples. A CAPTCHA might as well state "no cripples". But this is done in the spirit of 'we dont want automated bots here' - and real humans suffer. Why was WATSON, the IBM AI cancelled? Because it kept recommending "treatments" that would kill its patients. At least it was probably killing people in a non-biased way. https://www.theverge.com/2018/7/26/17619382/ibms-watson-cancer-ai-healthcare-science https://www.theverge.com/2018/7/26/17619382/ibms-watson-canc...