4 ms·
Sorry, I'm being a little academic. Overfitting is when the model fits to noise or error. Overfitting is not synonymous with "inability to generalize beyond the
by argonaut 11y ago
Sorry, I'm being a little academic. Overfitting is when the model fits to noise or error. Overfitting is not synonymous with "inability to generalize beyond the train and test distribution."
For all we know AlphaGo has perfectly fit amateur games, but professional games are on a whole different level
- tel 11y agoAll depends on how you define your data sets I suppose. IGS games include some professional games which, if it is the case that AG is perfectly trained on the amateur mode, were smoothed away.
- argonaut 11y agoAgain, the only way to tell if overfitting specifically (and not other factors that are more likely) is the issue is performance on a held out test set.
- tel 11y agoThat's the only empirical way, yes. We can also just talk about what it would mean in theory, though. In this case, we'd say that AlphaGo is well trained to the training data set sampling distribution but that may be far from the actual world game distribution.
- argonaut 11y agoThat does not relate to overfitting. That problem is closer to "domain adaptation."
- ktRolster 11y agoUnlikely. Some of AlphaGo's moves were lousy moves, even for an amateur.
- argonaut 11y agoYou are implying overfitting is the only reason a model ever performs poorly. That is not true. Just because a model does poorly does not mean overfitting must be the issue.