The Netflix challenge was quite a while ago now. Since then Kaggle has added things like Kaggle kernels, where the models are trained on data they haven’t seen

The Netflix challenge was quite a while ago now. Since then Kaggle has added things like Kaggle kernels, where the models are trained on data they haven’t seen before (not just evaluated). Resources and training time are also kept even between submissions.