It's a problem because it's illegal in many countries, including in the US. Whether you think it's morally justified or not isn't the problem -- the fact that i

It's a problem because it's illegal in many countries, including in the US. Whether you think it's morally justified or not isn't the problem -- the fact that it's illegal is. With these laws in mind, is an algorithm that says "people who tend to purchase cosmetics are better drivers" illegal? Is an algorithm that says "people who tend to purchase cocoa-butter-based skin creams tend to have worse driving records" illegal? Should their be some sort of test put in place for these algorithms to make sure they're giving out legally-okay results, just like government officials test the gas pumps to make sure they're pumping fairly? It really throws a wrench in the algorithm, because there are a million little unidentifiable things that are correlated one way or the other with race, gender, marital status, etc.