4 ms·
You don't think it's reasonable to think the training set comes from the real world? Why not? Seems like a reasonable assumption to me. The alternative is they
by n8ta 4y ago
You don't think it's reasonable to think the training set comes from the real world? Why not? Seems like a reasonable assumption to me.
The alternative is they are carefully curating a training set (google historically unwilling to do anything manually) or writing one themselves???
- astrange 4y agoYou can make the distribution different by eg duplicating some of the data a lot, which you might want to do to improve the actual purpose of the model (translation). Any other purposes (having opinions on gender) is just a coincidence and not being optimized for/regression tested.
- jhugo 4y agoThey said the training set distribution. It's frankly impossible that they have a training set without any biases, though I'm sure they worked to eliminate the ones they could think of (which itself would have bias).