3 ms·
> For example, the work determining sexual orientation from images (https://osf.io/fk3xr/ https://osf.io/fk3xr/). > The problem with this approach is you get
by kqr 8y ago
> For example, the work determining sexual orientation from images (https://osf.io/fk3xr/ https://osf.io/fk3xr/).
> The problem with this approach is you get predictive ability, but no insight.
Is it not possible to take one specimen and tweak it just a little at a time until it classifies as a different category, and that way find the border between categories?
- nerdponx 8y agoYes. It always bothers me when people claim you can't get insight out of a nonlinear black-box model, because you absolutely can. It's just not right in front of you, and it's not always as clear-cut as what you might find in a linear regression model. But even a linear regression model with quadratic interactions is already pushing the limits of interpretability, so it's not a problem that's unique to neural networks. It is, however, limited by computational ability. Partial dependence plots: https://journal.r-project.org/archive/2017/RJ-2017-016/RJ-2017-016.pdf https://journal.r-project.org/archive/2017/RJ-2017-016/RJ-20... Locally-interpretable model-agnostic explanations (LIME): https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime https://www.oreilly.com/learning/introduction-to-local-inter...