No, I'm not saying the he/she thing is worthy of prosecution. Straw man #2, nice. It is just an undeniable illustration that bias is encoded in machine learning

No, I'm not saying the he/she thing is worthy of prosecution. Straw man #2, nice. It is just an undeniable illustration that bias is encoded in machine learning models. Of course it requires some actual harm before the law is involved. Perhaps AI recruiting systems favour resumes that match the "correct" gender to profession. Perhaps a hypothetical AI sentencing recommender gives stiffer penalties to people that live in high crime areas; after all, statistically they are more likely to re-offend - that's just not an acceptable sentencing factor. Perhaps a house appraisal AI accidentally recreates redlining. These are just hard to prove, so my example is there to demonstrate that even though it's hard to demonstrate we should take the risk seriously.