3 ms·
Do you mean {inclusive or exclusive} "Or"? I'd say there's something wrong with computer sciences, and Minsky was brilliant, and right about some things, and wr
by DonHopkins 11y ago
Do you mean {inclusive or exclusive} "Or"? I'd say there's something wrong with computer sciences, and Minsky was brilliant, and right about some things, and wrong about other things.
>He [Aaron Sloman, one of the small group of "each other" who talk to each other] disagrees with all of these on some topics, while agreeing on others.
- argonaut 11y agoVirtually no active researcher in AI today believes we'll achieve AI or "common sense" or anything remotely related to thinking/reasoning by hardcoding facts/rules/laws and doing logical inference / deduction on those facts.
- DonHopkins 11y agoThat's not what Minsky or Sloman said they believed, nor what I meant to imply. http://web.media.mit.edu/~minsky/papers/CausalDiversity.html http://web.media.mit.edu/~minsky/papers/CausalDiversity.html Minsky: What is the answer? My opinion is that we can make versatile AI machines only by using several different kinds of representations in the same system! This is because no single method works well for all problems; each is good for certain tasks but not for others. Also different kinds of problems need different kinds of reasoning. For example, much of the reasoning used in computer programming can be logic-based. However, most real-world problems need methods that are better at matching patterns and constructing analogies, making decisions based on previous experience with examples, or using types of explanations that have worked well on similar problems in the past. How can we encourage people to make systems that use multiple methods for representing and reasoning? First we'll have to change some present-day ideas. For example, many students like to ask, "Is it better to represent knowledge with Neural Nets, Logical Deduction, Semantic Networks, Frames, Scripts, Rule-Based Systems or Natural Language?" My teaching method is to try to get them to ask a different kind of question. "First decide what kinds of reasoning might be best for each different kind of problem -- and then find out which combination of representations might work well in each case." A trick that might help them to start doing this is to begin by asking, for each problem, "How many different factors are involved, and how much influence does each factor have?" This leads to a sort of "theory-matrix." http://www.cs.bham.ac.uk/research/projects/cogaff/crp/#note-8-prob http://www.cs.bham.ac.uk/research/projects/cogaff/crp/#note-... Sloman: In retrospect, it seems that a mixture of the probabilistic and deterministic approaches is required, within the study of architectures for complete agents: a more general study than the investigation of algorithms and representations that dominated most of the early work on AI (partly because of the dreadful limitations of speed and memory of even the most expensive and sophisticated computers available in the 1960s and 1970s). There are many ways such hybrid mechanisms could be implemented, and my recent work on different processing layers within an integrated architecture (combining reactive, deliberative and meta-management layers) indicates some features of a hybrid system, with probabilistic associations dominating the reactive layer and structure manipulations being more important in the deliberative layer. For recent papers on this see - The Cogaff papers directory http://www.cs.bham.ac.uk/research/cogaff/ http://www.cs.bham.ac.uk/research/cogaff/ - My "talks" directory: http://www.cs.bham.ac.uk/research/projects/cogaff/talks/ http://www.cs.bham.ac.uk/research/projects/cogaff/talks/ - The rapidly growing "miscellaneous" directory: http://www.cs.bham.ac.uk/research/projects/cogaff/misc/AREADME.html http://www.cs.bham.ac.uk/research/projects/cogaff/misc/AREAD... More specific though less comprehensive models have been proposed by other researchers, one of the most impressive being the ACT-R system developed by John Anderson and his collaborators. See http://act.psy.cmu.edu/ http://act.psy.cmu.edu/. Added 8 Feb 2016 Minsky's paper on "causal diversity" is also relevant: Marvin L. Minsky, 1992, Future of AI Technology, in Toshiba Review, 47, 7, http://web.media.mit.edu/~minsky/papers/CausalDiversity.html http://web.media.mit.edu/~minsky/papers/CausalDiversity.html ---- Will Wright discusses how he applies several different kinds of representations to make hybrid models for games, in the democratically elected "Dynamics" section of his talk, "Lessons in Game Design", on "nested dynamics / emergence" and "paradigms". https://youtu.be/CdgQyq3hEPo?t=35m7s https://youtu.be/CdgQyq3hEPo?t=35m7s
- argonaut 11y ago> He named Douglas Lenat as one of the ten or so people working on common sense (at the time of the interview in 1998), and said the best system based on common sense is CYC. I also should have been more strong in my statement. Very few active ML/AI researchers believe the database + logical deduction / inference method will even play a nontrivial role in any future AGI system.
- abecedarius 11y agoI don't have any strong opinion about this, but it's suggestive that AlphaGo combines a classical AI search with neural nets. Another example: Steven Pinker's theory that human language uses a combo of neural-net-style and logic-style processing (Words and Rules). This isn't to say that Skynet will run part of itself on Prolog -- more like, to get the best performance over the broadest range of domains will need multiple techniques. One advantage of logic + deduction is potential clarity ahead of time about what the system might do, and ability to explain its actions. If AI safety is your top concern, those seem at least potentially valuable even when other techniques can build powerful systems sooner. (I wish more conventional software had that kind of transparency.)
- arthur_pryor 11y ago> One advantage of logic + deduction is potential clarity ahead of time about what the system might do, and ability to explain its actions. If AI safety is your top concern, those seem at least potentially valuable even when other techniques can build powerful systems sooner. (I wish more conventional software had that kind of transparency.) i'm not particularly fearful of an AI apocolypse, but i couldn't agree with that more.
- argonaut 11y agoI'm talking about logical inference on a database of facts in the hopes of representing common sense. I have no issue with probabilistic state-space search.
- deleted 11y ago[deleted]
- AnimalMuppet 11y agoI meant exclusive or. I was getting at the arrogance: "Out of all the AI people, only the 5 of us talk to each other. There must be something wrong with the whole field, because they can't see how right we are!" The arrogance - that "we" clearly are right, so "they" clearly must be wrong - grates on me. Minsky may in fact be right, but he should at least have the humility to see that, in a difference of opinion between the few and the many, it is at least possible that the many are right...
- nickpsecurity 11y agoCommon sense powers the many's decisions around 90% of their day. It seems to be a prerequisite for many intelligence functions. Many AI's screw up or are ineffective entirely in real-world because they lack it. And only around five pro's were working on it. I think there's no arrogance in saying the many were foolish to ignore the most used and probably critical part of intelligence. Especially when their work failed due to lacking it. If anything, those thinking they didnt need it were very arrogant in thinking their simple formalisms on old hardware would replace or outperform common sense on wetware. Besides, time showed who were the fools. ;)
- AnimalMuppet 11y ago> Besides, time showed who were the fools. ;) Who, in your view, would that be? The people who thought that rule-driven inference engines were going to get us strong AI? OK, I can give you that events have proven that view to be foolish. The people who thought that common sense was not the way to AI? Time has not shown that they are fools (at least, not yet), because no impressive AI advances (of which I am aware) are based on the common-sense approach. (I suppose CYC itself could be regarded as such an advance, but I see it more as building material than as a system in itself.) Now, DonHopkins quotes Minsky as saying that a mix of approaches is the answer. Arguably, that is beginning to be proven. Common sense (the CYC approach)? Not so much.
- DonHopkins 11y agoHow is CYC not just another lego in the toolbox, as Wright would put it, like any of the other approaches you can combine together?