6 ms·
This may come as a shock to the layperson, but there's more to artificial intelligence than neural nets, and many non-NN AI approaches could arguably be said to
by pmoriarty 10y ago
This may come as a shock to the layperson, but there's more to artificial intelligence than neural nets, and many non-NN AI approaches could arguably be said to "learn", and are thus "machine learning" too, depending on your definition.
I'm thinking of evolutionary algorithms, various other biologically inspired computation techniques (of which NN's are but one example), more traditional AI techniques such as expert systems, and a whole host of stochastic, non-biologically inspired algorithms.
I'm not super familiar with NN's myself, so I can't say whether the gigantically disproportionate attention from the media and the research community is deserved based on actual superiority in effectiveness of NN's compared to other techniques, or whether they're used and talked about mostly because that's what most people know.
It would be interesting to hear the thoughts of a non-NN AI researcher regarding this.
- NhanH 10y agoI've been looking to learn more about non-machine learning AI research for the past couple of months (essentially, something that is the spiritual successor to the GOFAI/expert system path instead of the currently popular statistical machine learning path). For some reasons it's quite hard. I'd appreciate if anyone can point me to the state of the research in those areas? (Conferences, research groups' names etc).
- sbw1 10y agoClassic non-ML AI research these days sometimes tends to be baked into the background of systems where deep learning is the star-- e.g., all of the search techniques used in AlphaGo are interesting in their own right, but aren't really where the innovation is there. There are researchers actively looking at more holistic AI systems that aren't just the core learning part (often called cognitive architectures). For instance, take a look at Soar: http://soar.eecs.umich.edu/ http://soar.eecs.umich.edu/ It under active development, and has been since the 80s. Soar is very much a spiritual successor to GOFAI (or maybe still is GOFAI), but does incorporate statistical machine learning-- much of the recent work has been around integrating reinforcement learning with symbolic decision-making. ACT-R is another cognitive architecture under active development, but is more used for cognitive modeling (i.e. psychology research): http://act-r.psy.cmu.edu/ http://act-r.psy.cmu.edu/ You can find other related systems by searching for "cognitive architecture", but it is unfortunately a field that attracts a lot of proposals/'designs' for things that never get properly implemented (the above being two notable exceptions).
- YeGoblynQueenne 10y agoIf you're looking for symbolic approaches within machine learning, Luc De Raedt's textbook has the works: http://www.springer.com/us/book/9783540200406 http://www.springer.com/us/book/9783540200406 Lise Getoor from MIT is also doing a lot of work with statistical relational learning in particular, which is kind of a cross between GOFAI (the "relational" bit) and nouveau AI (the "statistical" part): http://www.cs.umd.edu/srl-book/ http://www.cs.umd.edu/srl-book/ In the UK I know of Kristian Kersting who does statistical relational learning research, at Dortmund: http://www-ai.cs.uni-dortmund.de/PERSONAL/kersting.html http://www-ai.cs.uni-dortmund.de/PERSONAL/kersting.html I think this is not exactly what you were asking for but I think you might find it interesting, particularly Inductive Logic Programming (of which there's oodles in De Raedt's book). Personally, I started an MSc in AI because I was interested in all the symbolic stuff, and I was a bit disappointed to find there were almost none of that left in the curriculum (at my school anyway, the University of Sussex). I guess I kind of see the point though- knowledge engineering is pretty hard and costly and learning from data is very attractive. I really don't like the idea of doing it all with statistical black-boxes, though. So relational learning is a kind of halfway house for me, where I can still use mathematical logic principles and not have to eat the statisticians' dust, so to speak. For me relational learning is the spiritual successor of GOFAI that I was looking for, so I think you may find something of interest in the links above. Edit: there's also the probabilistic logic programming community, forgot about them; here: https://dtai.cs.kuleuven.be/problog/ https://dtai.cs.kuleuven.be/problog/ That's from the University of Leuven, where De Raedt is from. The name says it all: Horn clauses with probabilistic weighting. So that's not machine learning (or any kind of learning, it's just what it says on the tin). You will find many more here: http://probabilistic-programming.org/wiki/Home http://probabilistic-programming.org/wiki/Home Although that's not all _logic_ programming (but there's quite a bit of it).
- kmiroslav 10y agoNN are being talked about because they have been excessively effective at advancing the state of the art in areas that were previously in a dead end. Computer vision is such a field. The results provided by conventional approaches had been plateauing for years and then one day, Yann Le Cunn submitted a paper describing the work that he and his team had done in the area with neural networks and which blew away the previous results on image recognition. Interestingly, this paper was rejected and it took a full year to the CV community to finally turn around and accept NN as a valid approach to this problem. I believe no one questions that it's the best methodology we have today. Speech recognition, automatic translation and natural language processing in general are other areas that have benefited immensely from neural networks.
- YeGoblynQueenne 10y ago>> Speech recognition, automatic translation and natural language processing in general are other areas that have benefited immensely from neural networks. In NLP in particular, I'm not so sure about the "immense" benefit of ANNs. LSTM-RNNs are very nice for language modelling but we haven't seen the 10-percentile jump in performance that the image processing community has. Stanford I believe uses ANNs in their dependency parser (to learn transitions) and Google of course uses ANNs everywhere, but the gains against goold old HMMs are nowhere near the gains in image processing and it's not clear what exactly is the difference. Maybe teams have better hardware and more data now. Rather, they definitely do, so maybe that's the reason for any increases in performance. With translation in particular (it's a branch of NLP) it's very hard to know what's going on. Companies who sell machine translation products still use different techniques, including rule-based software. The problem is that machine translation needs some way to deal with semantics, else it's a bit shit. Google again- they do use ANNs (apparently- it's hard to tell because they don't) but is their translation any better than others'? That's almost impossible to know, because there are no good measures of machine translation performance. I'll repeat that: we don't have any good measures of machine translation performance. So anyone can come up with a solution and drum it up as "state-of-the-art", and if their user base is large enough it'll be impossible for anyone (even themselves) to know for sure whether that means anything. Speech recognition- I don't know much about that, but I think it's similar to NLP. You can do a lot with a lot of data and hardware, if you're lucky to have them and at that point it doesn't really make a real difference to your end-user if you're using an ANN model or an HMM model.
- deleted 10y ago[deleted]
- hacker42 10y agoThe answer to the question which technique will lead to AI depends on who you ask. Geoffrey Hinton and Jürgen Schmidhuber are convinced that neural nets trained with backprop will likely lead to AI with minimal additional fixed-function structure. Schmidhuber's intuition is that recurrent neural networks (RNNs) are capable of universal computation, so given sufficient computational resources the RNN can learn any task, including generalization, goal and action selection and everything else that we associate with intelligence. Hinton's intuition is that RNNs essentially accumulate representations in their hidden state vectors that are very similar to human thoughts ("thought vectors"). Hinton thinks that thought vectors will naturally lead to the kind of reasoning that humans are capable of. In his view the human brain is basically a reinforcement-modulated recurrent network of stacks of autoencoders (needed for unsupervised representation learning). Pedro Domingo sees such universally that may lead to AI in all major fields of AI: (1) Symbolists have inverse deduction (finding a general rule for a set of observations), (2) Connectionists have backprop and RNNs (see above) (3) Evolutionists have genetic programming (improvement of programs via selection, mutation and cross -over), (4) Bayesianists have incremental integration of evidence using Bayes' theorem, e.g. dynamic Bayes networks, and finally (5) Analogizers have kernel machines and algorithms to compare things and create new concepts. Domingo's hypotheses is basically that only a combination of various of these approaches will lead to AI.
- jsprogrammer 10y agoIs there a proof that generalization or goal and action selection or other things associated with intelligence are actually computable? If the Strong Free Will theorem is right, there are distinct limits on the ability of computational devices to simulate our physics. For one, anything a computable machine does "on its own" will be a function of the past history of the universe (deterministic), whereas the SFWT says that elementary particles are free to act without regard to the entirity of history. E: even a one word reply conveys so much more than an anonymous downmod.
- kabouseng 10y agoI didn't downvote you but I suppose the criticism would be that our machines are built from the same elementary particles that a brain is, so why would our machines suddenly be so deterministic as to disallow strong ai but a brain is not. Furthermore a ai does not compute a physics model any more than a brain does, so the criticism does not apply.
- YeGoblynQueenne 10y ago>> more traditional AI techniques such as expert systems I believe you'll be hard pressed to find anyone that describes expert systems as "learning" in any way. They're typically considered as the antithesis of machine learning: they're knowledge-driven but you have to enter all the knowledge "by hand". Indeed some machine learning algorithms were proposed as ways to automate the creation of the large rule-bases typical of expert systems (the most prominent such algorithm being Decision Trees). >> It would be interesting to hear the thoughts of a non-NN AI researcher regarding this. Researchers are rarely as proscriptive as that. You may find folks who specialise in ANNs to the exclusion of other techniques (but it's true it's a vast field) but you'll probably not find anyone who wouldn't try ANNs a couple of times, and maybe publish a paper or two on them. Same goes for other trendy algorithms also.
- anantzoid 10y agoIn fact, the recent massive success of Deep Neural Nets have led to the terms 'Artificial Intelligence', 'Machine Learning' and 'Deep Learning' being used interchangeably. This was not the case till early 2015. In order to inform the masses about the breakthroughs, the media started generalising DNNs as AI, and also because this was the only AI technique to show such results.
- wahern 10y agoA state-of-the-art handwriting recognition algorithm was published late last year, based on a new approach the authors termed Bayesian Program Learning: http://science.sciencemag.org/content/350/6266/1332 http://science.sciencemag.org/content/350/6266/1332