3 ms·
Yes. It always bothers me when people claim you can't get insight out of a nonlinear black-box model, because you absolutely can. It's just not right in front o
by nerdponx 8y ago
Yes. It always bothers me when people claim you can't get insight out of a nonlinear black-box model, because you absolutely can. It's just not right in front of you, and it's not always as clear-cut as what you might find in a linear regression model. But even a linear regression model with quadratic interactions is already pushing the limits of interpretability, so it's not a problem that's unique to neural networks. It is, however, limited by computational ability.
Partial dependence plots: https://journal.r-project.org/archive/2017/RJ-2017-016/RJ-2017-016.pdf https://journal.r-project.org/archive/2017/RJ-2017-016/RJ-20...
Locally-interpretable model-agnostic explanations (LIME): https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime https://www.oreilly.com/learning/introduction-to-local-inter...