2 ms·
You missed the standard solution used in machine learning. Randomly divide your data into two halves. Train your model on one half. Then test it on the other
by btilly 16y ago
You missed the standard solution used in machine learning.
Randomly divide your data into two halves. Train your model on one half. Then test it on the other.
This eliminates most of the randomly discovered patterns. It also leads to a much better sense of exactly how many different ideas you tried, and therefore how high the level of statistical evidence needs to be on your successes.