3 ms·
700,000,000 years ago to 300,000 years ago: all of nervous system life gets by on "pattern detection" and "curve fitting" (Judea Pearl's term for deep learning)
by tshadley 8y ago
700,000,000 years ago to 300,000 years ago: all of nervous system life gets by on "pattern detection" and "curve fitting" (Judea Pearl's term for deep learning).
Homo neanderthalesis or thereabouts to modern day: language, reason, cause and effect.
> Today’s dominant approach to A.I. has not worked out.
But "curve fitting" biological neural networks needed 2500 times more architectural exploration and enhancement to get to rudimentary language capacity than rudimentary language architectures needed to achieve all of human knowledge. That suggests we're doing the right thing in growing and enhancing deep neural network architectures now. Evolution suggests the next step to language and reason on the right architecture is comparatively easy.
- tacon 8y ago>Evolution suggests the next step to language and reason on the right architecture is comparatively easy. <Something> suggesting the next step to language and reason is the right path and easy is the rhyming history of AI for sixty years. "This time it's different."
- tshadley 8y ago> <Something> suggesting the next step to language and reason is the right path and easy is the rhyming history of AI for sixty years. If evolution can be taken as a successful search through the space of what is possible, language and reason are on the path from curve fitting. But calling this "easy" is far from my point. If evolution is any sort of guide, deep neural network architectures are where the real work is needed before language understanding is possible (contra Pearl, Marcus).