3 ms·
Once these systems get complicated enough, it gets really hard to do that. Unless you are doing linear models or tree ensembles, it can be really difficult to g
by mjhay 4y ago
Once these systems get complicated enough, it gets really hard to do that. Unless you are doing linear models or tree ensembles, it can be really difficult to get a clear picture of variable importance/effects. It's one thing to extrapolate locally (fine for linear models), but that has little to do with anything relevant when there's lots of higher-order interactions.
- RodgerTheGreat 4y agoWhat is a safer assumption? - My model is accurate, for reasons I can't understand, verify, or externally justify - My model is not accurate edit: to be more clear on my stance, if a modeling technique is too difficult to justify or explain, it is not a good technique and should not be used, even if the results seem appealing.
- mjhay 4y agoThe second one. It's important to have a clear picture of biases and how your model could fail to generalize. In the case of social data from a deeply biased society, these issues can be seen a mile away.
- jerf 4y ago"Once these systems get complicated enough, it gets really hard to do that." That's why I qualified it. Obviously if you're working in neural nets, you're not going to be cracking open that hood. But one of the dirty secrets of ML is you don't always need those techniques. There's the space of problems where linear regression and similar techniques are all you need, there's the class of problems where it doesn't matter what you throw at it you're not getting anything, and the "in between" where deep learning and such helps certainly has some interesting problems in the space, but it isn't necessarily the majority of problems you encounter in the wild. The scary thing is that not being able to crack open the hood doesn't mean the model isn't complete nonsense. It just means you can't examine it.