2 ms·
Andrew Ng in the linked message said himself: "Maybe you’re training XGBoost on a structured dataset and wondering if you’re missing out on ChatGPT. You may wel
by nl 4y ago
Andrew Ng in the linked message said himself: "Maybe you’re training XGBoost on a structured dataset and wondering if you’re missing out on ChatGPT. You may well be onto something even if XGBoost isn’t in the news."
Boosting generally is very competitive with (or better than) neural networks on small to midsized datasets.
Bayesian techniques are always interesting.
Personally I think there are great opportunities linking knowledge engineering approaches (which are very manual-labor heavy) with neural network approaches so we can bridge the taxonomy/unstructured data divide.