3 ms·
> I'm not sure that neural network based AI can do that though. Generating human-readable explanations from a machine learning algorithm or NN is probably an i
by throwawaysocks 10y ago
> I'm not sure that neural network based AI can do that though.
Generating human-readable explanations from a machine learning algorithm or NN is probably an impossible problem to solve in full generality.
However, for many particular systems, doing so should be feasible.
- sapphireblue 10y agoExplaining how neural network models generate their output is possible, see http://cs231n.github.io/understanding-cnn/ http://cs231n.github.io/understanding-cnn/ https://auduno.github.io/2016/06/18/peeking-inside-convnets/ https://auduno.github.io/2016/06/18/peeking-inside-convnets/ https://courses.cs.washington.edu/courses/cse590v/14au/cse590v_dec5_DeepVis.pdf https://courses.cs.washington.edu/courses/cse590v/14au/cse59... Also it should be possible to train the NN model to explain its decision, even in plain language. I think the "right to explanation" law is pretty sensible, people should have a right to question the algorithmic judgment that impacts their life. It will be somewhat inconvenient for big companies applying ML to make these decisions, but it won't ruin their business.