3 ms·
Study Suggests That AI Model Selection Might Introduce Bias
- ggm 6y agoSuggests is a bit weak. We've known since decision support systems and expert systems started that its possible to codify bias, unconsciously. There was a notorious case in the UK, relating to medical school entry acceptance, which was in the 1980s and then repeated in more recent times I believe in Japan, and in the US for racial bias to ivy-league. Why would model training be any different? If the goal seeking drives to mimic what it sees, and what it sees systematically biases the selection e.g. since the ratio of men to women in a job is 70/30 the model selection mimics this. Isn't that what is going to happen, if you don't actively define the parameters you're tuning for?