> How different the inputs were, even along the criteria that the function actually uses in order to produce its output, is completely irrelevant This is why I

> How different the inputs were, even along the criteria that the function actually uses in order to produce its output, is completely irrelevant This is why I said this. The example you gave, where software was trained on people with lighter skin and therefore doesn't produce the intended results on people with darker skin, is noncontroversially racially biased. As in, control for everything but skin color, and the color of someone's skin is actually a parameter that the function "uses" in order to produce its output. For this reason, people tend to agree that this is an actual problem with the program that needs fixing.