4 ms·
> So they collect this data, vet it, propose their use for benchmarks and give it away free. What is the complaint? It's well known that neural networks can ea
by michaelt 5y ago
> So they collect this data, vet it, propose their use for benchmarks and give it away free. What is the complaint?
It's well known that neural networks can easily inherit biases from their training data. It's also well known that datasets generated by western universities are widely used in training and evaluating neural networks.
If my training set is full of pictures of Stanford CS undergraduates, I could end up with a computational photography system that makes everyone look like Stanford CS undergraduates, or a historical photo colourisation system that makes everyone look like Stanford CS undergraduates, or a self driving car pedestrian tracking system that expects 90% of pedestrians to look like Stanford CS undergraduates.
And if the people who make the model say "Hey, our model's biases aren't our responsibility, we're just representing the training data as best we can" and the people who make the training data say "Hey, we never claimed it was perfect, you can take it or leave it" these problems might fall through the cracks.
- mattnewton 5y ago> And if the people who make the model say "Hey, our model's biases aren't our responsibility, we're just representing the training data as best we can" I don't think this excuse is like the others. If the model doesn't work well because they used bias data, it is the job of the people making the model to find better data (or manipulate the training process to overweight some data and attempt to counteract the bias). I think the burden of responsibility has to be on the people who make models or put models into products to make sure the model is a good fit for the problem it is solving.
- 908B64B197 5y ago> It's well known that neural networks can easily inherit biases from their training data. It's also well known that datasets generated by western universities are widely used in training and evaluating neural networks. If my training set is full of pictures of Stanford CS undergraduates, I could end up with a computational photography system that makes everyone look like Stanford CS undergraduates, or a historical photo colourisation system that makes everyone look like Stanford CS undergraduates, or a self driving car pedestrian tracking system that expects 90% of pedestrians to look like Stanford CS undergraduates. Why then aren't foreign universities/companies simply... building their own datasets?