3 ms·

Many years of "human optimization" on the same old datasets must lead to severe overfitting, so these results should be taken with a grain of salt. Related rese

Many years of "human optimization" on the same old datasets must lead to severe overfitting, so these results should be taken with a grain of salt. Related research: https://arxiv.org/abs/1806.00451 https://arxiv.org/abs/1806.00451

bonoboTP 8y ago
Have you read the linked paper? It finds no evidence of such overfitting happening, despite common fears of this phenomenon. Quote: "This shows that the current research methodology of “attacking” a test set for an extended period of time is surprisingly resilient to overfitting."