4 ms·
Sorry, I misspoke - will edit. Was talking about resistance to overfitting. Which largely comes from logistic regression's assumption of a linear decision bound
by bunderbunder 8y ago
Sorry, I misspoke - will edit. Was talking about resistance to overfitting. Which largely comes from logistic regression's assumption of a linear decision boundary. It's true surprisingly often in classification tasks, and, when it's not, you can usually model it just fine with interaction variables.
With an ANN, your easiest defense against overfitting is to have great big heaping piles of training data. That's something that's hard to come by in many interesting situations.
- polkapolka 8y agoAgreed. Logistic regression with poly kernel or good engineering interactions can equal or beat more complex models for a fraction of the budget. All the more power to you if a solid simple logreg model (or even no ML at all) is your first deliverable.