3 ms·
Validation isn't "a trick", or shouldn't be. It's just being responsible. I'm sure there are people getting funded who don't know about it, but they're charlata
by michaelochurch 13y ago
Validation isn't "a trick", or shouldn't be. It's just being responsible. I'm sure there are people getting funded who don't know about it, but they're charlatans if they don't understand the dangers of overfitting (and underfitting).
- tlarkworthy 13y agosee the early history of learning, it was a discovery that is actually counter intuitive and a common trap for beginners. (don't minimize the training error) I have seen new PhDs read about it "in theory", but not internalise it for practice, and then they go off an do Bayesian structure learning without a validation set. This DOES happen. This post is to hammer into the brains of any beginner thinking about machine learning that understanding the validation set's purpose is the most important thing to internalise first. e.g. Machine learning is easier than it looks: https://news.ycombinator.com/item?id=6770785 https://news.ycombinator.com/item?id=6770785