3 ms·
My first AI teacher (even before '89) compared solving AI with neural nets to teaching pigs to fly by throwing them from a tower. Improvements come from buildin
by tgv 6y ago
My first AI teacher (even before '89) compared solving AI with neural nets to teaching pigs to fly by throwing them from a tower. Improvements come from building higher towers.
There's a recent NLP model that was trained on a trillion words. It would take us 10,000 years to read or listen (no breaks, no sleep) to that many words. Problems like attention, and the relation between memory and sequential thinking haven't been cleared up at all. Even semantics, i.e. basic understanding of a utterance or a scene, is in its infancy.
Large neural nets can help with interesting problems, but it's not going to mimic our style of thinking any time soon.
- mjburgess 6y agoIt isn't ever going to model our style of thinking. A "neural network" is just high-dimension linear regression; the idea it has anything to do with the brain is metaphorical nonesense. No algorithm running on digital hardware can emulate the biological process of animal intelligence.
- machiaweliczny 6y agoWhy not?
- mjburgess 6y agoWhat algorithm running on a digital computer would make the computer transparent?