3 ms·
You might also be interested in algorithms like Adaboost [0] and its successors, including the various "gradient boosting" algorithms like XGBoost, LightGBM, an
by nerdponx 9y ago
You might also be interested in algorithms like Adaboost [0] and its successors, including the various "gradient boosting" algorithms like XGBoost, LightGBM, and the newly-open-sourced
Catboost.
0: https://jeremykun.com/2015/05/18/boosting-census/ https://jeremykun.com/2015/05/18/boosting-census/
- shoo 9y agoa great paper on this is Friedman's "gradient boosting machine" paper, where he shows how the boosting idea can be generalised to support a range of different loss functions and underlying approximation schemes (especially trees). "Greedy function approximation: a gradient boosting machine" - JH Friedman