3 ms·
As an author, I'm happy to see this work here. For those curious about what we have been up to on the topic of tabular learning, we have found a setting where
by GVaroquaux 3y ago
As an author, I'm happy to see this work here.
For those curious about what we have been up to on the topic of tabular learning, we have found a setting where deep learning does seem to bring sizable benefits (spoiler alert, it's about being able to pre-train, and transferring to new data works best when there are some strings to be recognized): https://arxiv.org/abs/2402.16785 https://arxiv.org/abs/2402.16785
In the above work, pre-trained tabular models markedly outperform tree-based models (including catboost, which is a very strong baseline).
As someone who has been banging on tabular data for years, I'm really excited about this development.