3 ms·
I have one question for you and Demis What if logic itself is just reduction to a simple binary system with few moving parts - the easy case? Being able to lo
by EGreg 8y ago
I have one question for you and Demis
What if logic itself is just reduction to a simple binary system with few moving parts - the easy case?
Being able to logically explain how something works in special cases is what we have been able to do until now with pencil and paper.
Then you get approaches in the more general case, like New Kind of Science by Stephen Wolfram to “study” self-similarity. And you have fluid dynamics, which oncd again tries to find analytic closed-form solutions after averaging.
But what if - with computers - you can GENERALIZE REASONING ABOUT MODELS to something far beyond logical explanation? And it’s not reducible to a few main factors, but instead relies on precomputing HUGE VECTORS via gradient descent or MCTS (like AlphaZero) and store that information compactly. So you can’t really explain “why” this move is (one of) the best moves, it just is.
What if you could generalize AND handle a greater set of problems and “logic” was just a subset of it after all?
Ideas like “all swans are white” and syllogisms are just approximations of the real world. With deep learning you can find patterns that contain far more variables and complex interrlationships.
So maybe the 80s AI will suddenly emerge as a super-logical reasoning computer, not from efforts like Cyc which attempt to feed it data, but from general purpose deep learning with zero experience!
What if it is suddenly better than everything humanity has ever produced or reasoned about, similar to how AlphaZero beat every bespoke chess computer program ever written after a few hours of training?
- mindcrime 8y agoSo maybe the 80s AI will suddenly emerge as a super-logical reasoning computer, not from efforts like Cyc which attempt to feed it data, but from general purpose deep learning with zero experience! That's a fair point, and I've spent some time thinking about roughly the same thing. My current thought on it is this: "general intelligence" may well turn out to be an emergent property of very simple lower-level primitives, and it may be that what we call "deep learning", done with a sufficiently deep and wide network, might actually produce "general intelligence". But... I feel like we're still pretty far from having the compute power to run an ANN of such scale (that's just a guess though). So where we can "help" the process by hand-engineering modules that do specific elements of what we call intelligence, combine those modules, that's one way to short-cut the process. And in my view, things like Deep Learning, DRL, MCTS, etc. would also be included, along with older approaches: PCT for abductive inference, logical inference, maybe something like symbolic regression with GA's, etc., etc.