8 ms·
You'd have to recreate your validation if you trained your model on it every iteration and then they wouldn't be consistent enough to show any trends
by parineum 1y ago
You'd have to recreate your validation if you trained your model on it every iteration and then they wouldn't be consistent enough to show any trends
- jfengel 1y agoI'd have thought that if you kept the same validation you'd risk over fitting. Clearly that does make it hard to measure. I'd think you'd want "equivalent" validation (like changing the SATs every year), though I imagine that's not really a meaningful concept.