4 ms·
I've put in production numerous models with millions of tabular data points and a 10^5-10^6 feature space where tree-based models (or FF nets) outperform more c
by mochomocha 4y ago
I've put in production numerous models with millions of tabular data points and a 10^5-10^6 feature space where tree-based models (or FF nets) outperform more complex DL approaches.
- whymauri 4y agoI'll chime in with billions of data points and 100-300 feature space with some smart feature engineering outperforming DL in runtime/compute (by orders of magnitude) and performance. But the domain was very specific and everything prior to the tree was doable with matrix operations, with the tree model summarizing a mixture of experts that chose optimal features.
- bloudermilk 4y agoDamn, this sounds fascinating! Have you shared more anywhere eelse?
- adamsmith143 4y agoWhat kind of freakish tabular data do you have with a million columns??
- ramraj07 4y agoA badly defined one probably? At least for one of the test arms.
- mochomocha 4y agoCategorical variables in the datasets of large tech companies can take a lot of different values.