3 ms·
What do you mean by p-hacking? In statistics that refers to running a large number of experiments and taking the one with the best results, but ML trains for hu
by jaredtn 6y ago
What do you mean by p-hacking? In statistics that refers to running a large number of experiments and taking the one with the best results, but ML trains for hundreds of thousands of steps on a single model.
- T-A 6y agoML runs hundreds of thousands of experiments, each on a slightly different model, and takes the one with the best results.
- ponker 6y agoThat's not necessarily p-hacking. It becomes p-hacking when the model is hyperoptimized to the test set and thus fails when applied to new data from outside the test set.