2 ms·
>> As far as I know, most of the work in AI explainability and interpretability—with the former applying to any system for which reasoning can be generated and
by YeGoblynQueenne 6y ago
>> As far as I know, most of the work in AI explainability and
interpretability—with the former applying to any system for which reasoning can
be generated and the latter applying to “self-explainable” models that people
can understand more or less on their own—is still about developing different
techniques.
It's worth noting that expert systems, the dominant AI approach of the '80s and
'90s, were perfectly capable of explaining the reasons for their decisions. For
example, see chapter 4, "Explanation" in the free "Building Expert Systems in Prolog" ebook from Amzi Prolog that
describes a "mechanism of explanation" that walks backwards through the decision
process of the expert system studied:
https://www.amzi.com/distribution/files/xsip_book.pdf https://www.amzi.com/distribution/files/xsip_book.pdf
In that sense, the dominant approach nowadays, that of deep neural nets, is a
big step backwards: explaining a deep neural net's decisions is very hard.
To be a little critical, I think the article is trying to make a virtue out of
necessity, or perhaps it's just sour grapes. Who cares about explanation, it's
not a real problem, etc. Well, if modern AI was good at producing explanatiosn
of its decisions, you can bet that it would be offered up as a great advantage
of the current techniques. But because it's hard to do and the public, as
expressed by the NIST draft document, are getting impatient about it, then we
need to come up with excuses why no progress is been done.