4 ms·
Sure, I can see that L2 regularization being the norm is a point to be argued about. I am in the camp that believes there should be no regularization by default
by phonebucket 7y ago
Sure, I can see that L2 regularization being the norm is a point to be argued about. I am in the camp that believes there should be no regularization by default.
But I am confused by the outrage this has caused.
Scikit-Learn's documentation is great. I do not believe that many competent scientists and devs are making this mistake. I prefer to believe that they always knew about the defaults, disagreed with them, overrode them, and went on their merry way.
I also think these sorts of devs/scientists are less likely to chime into this debate, because they don't see what the fuss is about.
Edit: genuinely no pun intended about 'L2 regularization being the norm'. Fancy that.
- 6gvONxR4sf7o 7y agoEh, when I first encountered it I thought it was a really dumb default. It doesn't cause trouble, except maybe when I was first coming over from stats libraries, where every logistic regression function means what ever textbook tells you it is. But it's no real problem, so whatever. I'm not going to file an issue or submit a PR. It's dumb, but not a big deal. Saying it's stupid a stupid default right now isn't outrage, it's just bikeshedding that would otherwise be silly if it weren't specifically the topic of discussion.