2 ms·
> Especially since the models did seem to adapt well to the modified domain when trained on it. But only when trained on it. The models trained on only one mod
by yorwba 9y ago
> Especially since the models did seem to adapt well to the modified domain when trained on it.
But only when trained on it. The models trained on only one modified domain didn't generalize well to the others. Although the model trained on all datasets together generalized quite well to the corresponding test sets, that doesn't mean that there isn't some other kind of modification that can fool it.
This is what the authors say:
Our last set of experiments involves training on the fully
augmented training set, which now enjoys a variance of its
Fourier image statistics. We note that this sort of data augmentation was able to close the generalization gap. However, we stress that it is doubtful that this sort of data augmentation scheme is sufficient to enable a machine learning model to truly learn the semantic concepts present in
a dataset. Rather this sort of data augmentation scheme is
analogous to adversarial training [40, 9]: there is a nontrivial regularization benefit, but it is not a solution to the
underlying problem of not learning high level semantic concepts, nor do we aim to present it as such.
- wiz21c 9y agoIs it me or the part of the article you cite basically says : CNN are nice statistical tools but are nowhere close to forming practical conceptual understanding of the data set they're trained on ?
- mannykannot 9y agoThe first part of this paragraph (up to 'however') seems to be saying that training with their modified images did improve the ability of the resulting networks to generalize, while the remainder of the paragraph seems to cautioning against assuming that this means the problem is solved.