2 ms·
My personal feeling: I think that the "next big thing" will be making real progress in terms of integrating probabilistic approaches (like deep neural networks)
by mindcrime 10y ago
My personal feeling: I think that the "next big thing" will be making real progress in terms of integrating probabilistic approaches (like deep neural networks) and symbolic processing (think "prolog" or "planning algorithms", FOL, or "STRIPS", things of that nature).
Deep neural networks are great at recognizing patterns, but they still don't give us much in the way of reasoning. So, "I should start cleaning now because lunch is at 1:00 and it takes uncle Bob 30 minutes to drive over here..." kind of stuff is - so far - pretty much outside of the realm of ANN's.
If / when we have systems that can utilize the best of probabilistic pattern matching and formal logic, I think we'll see a dramatic improvement in the "intelligence" available.
Note that there is no reason, in principle (at least that I'm aware of) that "formal logic" might not ultimately turn out to be an emergent aspect of a sufficiently complex ANN. Given that our brain can do formal logic, and does at times, and is "just" neural networks as far as we know, it seems likely. That said, in the short-term, I'm guessing we'll have hybrid systems that explicitly feature various AI techniques that have been developed over the years, sharing some representations (of concepts, knowledge, etc.). Maybe the "thought vectors" that Geoffrey Hinton has spoken of could be a step down that path. I'm also curious to see if something like rule induction using CN2 might not play a role. Or maybe it'll involve "semantic networks", something like ConceptNet. Who knows?
If I had to summarize, I'd say the answer is something like "coming up with some form of knowledge representation that allows us to share 'thoughts' or 'knowledge' between disparate AI/ML systems".
- orthoganol 10y ago> Note that there is no reason, in principle (at least that I'm aware of) that "formal logic" might not ultimately turn out to be an emergent aspect of a sufficiently complex ANN. In principle, one reason against the ANN purist's approach for replicating human intelligence is that it ignores all the things our brains already have programmed from the moment we step into the world; we obviously aren't anything close to a blank slate. So I think there's a burden on advocates of pure ANN to explain why our core intelligence or "formal logic" is in fact independent of this pre-programming.
- mindcrime 10y agoSo I think there's a burden on advocates of pure ANN to explain why our core intelligence or "formal logic" is in fact independent of this pre-programming. That's a fair question, and I take no position on it. My take on ANN's is that they are useful tools. I'm not particularly interested in the degree to which they accurately replicate how the human mind works. I assume, perhaps too quickly, that the analogy is pretty close, but I admit that I can't prove that. In either case, I still feel relatively confident that formal logic could emerge on top of a sufficiently complex ANN. One thing I don't know off hand, which would be interesting, is whether or not any specific research has bee done on proving or disproving that assertion.
- orthoganol 10y agoI'm not sure... if you discard appeal to the human brain metaphor/ authority, which was the purpose of my comment, why should one be confident that formal logic could emerge from an ANN? It seems like the entire argument about the potential of ANNs replicating human intelligence revolves around an appeal to the human brain, but I think it's an extremely fragile metaphor.
- mindcrime 10y agowhy should one be confident that formal logic could emerge from an ANN? It's closer to a gut feeling than anything. I believe if fairly strongly, but I haven't done any research in terms of trying to prove the point one way or the other. Don't read too much into it... it's just something I think. I may well be wrong.
- eveningcoffee 10y agoour brains already have programmed from the moment we step into the world; we obviously aren't anything close to a blank slate. I believe that this statement dismisses the fact that humans have plenty of time to train their brains before the birth based on multiple sensory inputs.
- 10y ago