5 ms·
The "unreasonable effectiveness of data" in finding publishable results and creating commercially viable products ought to be blinding us (or rather "them" - AI
by _yosefk 12y ago
The "unreasonable effectiveness of data" in finding publishable results and creating commercially viable products ought to be blinding us (or rather "them" - AI researchers of whom I'm not one) to better ways to learn. A child learns to speak and recognize objects from much less data than contemporary machine learning/data mining/AI/whatever you call it needs.
Of course it's much better to keep your program small and your data sets huge than the other way around - we'd all do it if we could. But it ought to be a lot like keeping a 2^64-N look-up table to implement 32b integer multiplication; it's ultimately larger and costlier than figuring out how multiplication works, and you give wrong results for the N entries missing in your table.
Or something along those lines. (Of course natural languages are "scruffier"/not as "neat" as multiplication - but demonstrably not as scruffy as to be impossible to reasonably learn in any way except reading everything ever written and translated into another language.)
- incision 12y ago>"A child learns to speak and recognize objects from much less data than contemporary machine learning/data mining/AI/whatever you call it needs." You think? When a kid starts talking at 1.5, 2, 3 years or whenever they're doing so after being exposed to many thousands of hours of input, much of it effectively guided. Also, as far as I know, we don't have nearly enough understanding of the way the brain works to make a useful comparison between "records" fed to a model and all the analog input that goes into making a person.