3 ms·
If there are many examples of X on the web, and only a few examples of related Y, would you actively prohibit the additional X samples to be included in the tra
by aantix 2y ago
If there are many examples of X on the web, and only a few examples of related Y, would you actively prohibit the additional X samples to be included in the training set to prevent the reinforcement of the common case?
- scarmig 2y agoFor the purpose of generalization, I think that's more treating a symptom than the root cause. The better approach IMO would be finding architectures that heavily penalize the formation of memorizing and interpolating circuits. E.g much stronger weight decay than used today.