3 ms·
Absolutely agree on both counts. Gradient boosting is the most commonly known and most successful variant, but it's the decision tree structure that is the unde
by hodgehog11 6mo ago
Absolutely agree on both counts. Gradient boosting is the most commonly known and most successful variant, but it's the decision tree structure that is the underlying architecture there. Decision trees don't have the same "implicit training bias" phenomenon that neural networks have though, so all of this is just model bias in the classical statistical sense.
- energy123 6mo agoCan NNs be made to be better than trees on tabular data with some further constraints, or something?
- hodgehog11 6mo agoYou might find this interesting: https://arxiv.org/abs/1909.06312 https://arxiv.org/abs/1909.06312