4 ms·
I would really, really hope that they are using a good cross-validation strategy (as they'll definitely need it).
by disgruntledphd2 6y ago
I would really, really hope that they are using a good cross-validation strategy (as they'll definitely need it).
- randomsearch 6y agocross validation won't save you in this situation. it's a subtle point, but you can't say "omg this strain is increasing and it must therefore be more contagious" and then show that it is more contagious by showing it is increasing... this is counter-intuitive even to most scientists, in my experience. I remember when I learnt this during my PhD. I suspect many people high up in academia don't understand this point.
- randomsearch 6y agoan observation that may help: as your stats at time t+1 are dependent on stats at time t, you cannot separate your validation set from the set you used to perform exploratory data analysis - they are highly interdependent.