3 ms·
Do you have any insights as to why random forests are better (are they better?) in this context (or any context?) than boosted decision trees?
by j2kun 9y ago
Do you have any insights as to why random forests are better (are they better?) in this context (or any context?) than boosted decision trees?
- RMarcus 9y agoI've done no experiment, but I predict a boosted forest would perform poorly here. Since the first tree learns the majority of the information (and each of the following trees only fits the errors, and are therefore less "meaningful"). Since the kernel approach suggested here weights all the trees equally, the results probably won't be as good. Maybe if you gave the first trees more weight, though...
- j2kun 9y ago> Maybe if you gave the first trees more weight, though That is exactly what boosting does...and one would weight the kernel computation in the same way.