4 ms·
You know what AI systems had the ability to explain their decisions? Expert systems. Expert systems were the big success of GOFAI, but they fell out of favour
by YeGoblynQueenne 8y ago
You know what AI systems had the ability to explain their decisions? Expert systems.
Expert systems were the big success of GOFAI, but they fell out of favour in the last AI winter, at the end of the '90s or so, clearing the way for probabilistic inference and statistical machine learning.
Since then it seems, we took one step forward (with accuracy in classification) and one step back (with the loss of the ability to explain decisions).
Who knows, maybe a new AI winter will wipe out the statistical machine learning dinosaurs of today and leave a clear field of play for the AI Mammals of tomorrow.
- colllectorof 8y agoWell, there are some statistical learning models that are explainable. Decision trees can be induced and can "explain themselves", just like in expert systems. Additive models are self-explanatory. Not sure I'm sold on LIME and other similar approaches, though. Seems like a lot of deep learning people are all too happy to substitute "intepretability" for actual explanations.
- YeGoblynQueenne 8y agoDecision trees are not a statistical model. The learning method is statistical, if you will, but the model itself is a disjunction of conjunctions- a symbolic model (and more specifically, a propositional logic theory). Decision Trees are in fact an example of the early years of machine learning where the trend was towards algorithms and techniques that learned symbolic theories. I believe the effort was driven by the realisation that expert systems had a certain problem with knowlege acquisition [1] which drove people to try and learn production rules from data. I digress- I mean to say that decision trees are explainable because their models are not statistical. To be honest, I don't know much about additive models. _______________ [1] https://en.wikipedia.org/wiki/Knowledge_acquisition https://en.wikipedia.org/wiki/Knowledge_acquisition
- nickpsecurity 8y agoYup. That's what I learned first. Mycin being the first, success story I read about. https://en.wikipedia.org/wiki/Mycin https://en.wikipedia.org/wiki/Mycin I tried some quick DuckDuckGo-ing to see if anything new turned up. Drowned out by unrelated stuff. I did find what looks like a great, quick overview of expert systems for folks unfamiliar with them. Might be new, default link I share about how they historically were perceived. What you think of this one? https://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_expert_systems.htm https://www.tutorialspoint.com/artificial_intelligence/artif...
- sgt101 8y agoThe tutorial is a bit old. I think that advances in probablistic reasoning & modelling, such as practical Bayes networks should be included, and the mechanics of resolution have improved massively with the introduction of answerset systems - this gets over the problem of commitment that kiboshed gen 5. https://en.wikipedia.org/wiki/Answer_set_programming https://en.wikipedia.org/wiki/Answer_set_programming https://en.wikipedia.org/wiki/Probabilistic_programming_language https://en.wikipedia.org/wiki/Probabilistic_programming_lang...
- _bxg1 8y agoI work at this company: https://en.m.wikipedia.org/wiki/Cyc https://en.m.wikipedia.org/wiki/Cyc It's a survivor of the AI winter, and what we have is basically a generalized expert system. Every conclusion incorporates cross-domain knowledge and can fully explain itself. It's been a long, slow trudge of research and development over the past couple decades, but we're starting to poke our heads out and ride the current AI hype wave. We like to say that Watson is our marketing department.
- YeGoblynQueenne 8y agoI know about Cyc, of course. Godspeed [and speed us away] :)
- lawrenceyan 8y agoThis seems like a fundamentally flawed and ultimately doomed approach to creating general agents. It's like you're trying to build a house, except only one molecule at a time.
- _bxg1 8y agoThe intent is to seed it by hand with enough knowledge that it will be able to do true NLU and learn new knowledge itself from the web. It's already shown some promise against these sorts of problems, which ML really struggles with: https://en.m.wikipedia.org/wiki/Winograd_Schema_Challenge https://en.m.wikipedia.org/wiki/Winograd_Schema_Challenge
- nl 8y agoOpenAI's GPT-2 language model (build using a deep neural network) recently achieved 70.7% accuracy on the Winograd Schema Challenge, which is 8% better than the previous record[1]. I've never used Cyc but I have used OpenCyc and I'm familiar with some of the applications of Cyc. It's interesting when it works. [1] https://openai.com/blog/better-language-models/ https://openai.com/blog/better-language-models/
- lawrenceyan 8y ago