2 ms·
There are three separate lessons to be learned from this parable, and I think people are conflating them: 1. Training on a biased data set leads to biased pred
by nerdponx 9y ago
There are three separate lessons to be learned from this parable, and I think people are conflating them:
1. Training on a biased data set leads to biased predictions. This is undoubtedly true.
2. Data sets can be biased in unexpected and unforeseen ways, so therefore productions can also be biased in unexpected and unforeseen ways. The examples at the end of this article don't quite touch on that point. But examples of this abound in social science. Eg: https://blog.conceptnet.io/2017/07/13/how-to-make-a-racist-ai-without-really-trying/ https://blog.conceptnet.io/2017/07/13/how-to-make-a-racist-a...
3. Deep and convolutional neural networks are susceptible to this phenomenon. This is the point that the article is debating.