5 ms·
Not AI, but so called Deep Learning meme. AI has been already well-researched in 90s. The improvements in classification algorithms and the early commercializ
by lngnmn 10y ago
Not AI, but so called Deep Learning meme.
AI has been already well-researched in 90s.
The improvements in classification algorithms and the early commercialization, such as Siri or FB face recognition are responsible for the current bubble.
No major breakthrough in AI has been made so far. Better classifiers is not AI. They are mere pattern recognition.
- LoSboccacc 10y agostill there's good monet fooling vc around until they catch with the trick, that's why plenty startup sprinkle intelligence jargon on whatever they sell.
- frozenport 10y agoYeah. We got money to build a medical instrument but sold it as AI to investors.
- adrianN 10y agoIn science and engineering you almost never have a "major breakthrough" where some radical change happens over night. Progress is made by slow incremental improvements. Only from a historian's bird-eye view can you make statements like "the steam engine started the industrial revolution". Steam engines existed before James Watt. He just improved them a little to make them commercially viable. AI in particular suffers from poor definitions. Nothing computers can do is "AI", only the things that are still impossible can be called "AI". Doing arithmetic was once thought to be a sign of intelligence. So was playing Chess, or Go, or recognizing faces. Now that computers can do this easily it is no longer considered difficult. So while the recent progress with neural networks is likely somewhat overhyped you shouldn't discount the importance of making things commercially viable. In the 90s we had software that could do image recognition, true, but it wasn't accurate enough, general enough, fast enough to be useful in practice. This has changed over the last ten years to the point where image recognition has tons of commercial applications.
- marcosdumay 10y ago> Only from a historian's bird-eye view can you make statements like "the steam engine started the industrial revolution". I'm always baffled by that example. The Industrial Revolution was already ongoing when the steam engines become practical.
- archgoon 10y agoSeems like it's unintentionally apt then ;)
- goatlover 10y agoSo we have better, commercially available, versions of what existed decades ago. That's progress, but is it progress toward general AI?
- adrianN 10y agoMaybe. We don't know how to do general AI yet, so nobody can really tell.
- maverick_iceman 10y agoIt's revealing when you read older books pontificating about why computers can never be as smart as humans. They would say things like a computer will never be able to write poetry, prove a theorem or play chess like an expert. Now that computers have achieved all of that of course the goalposts have shifted.
- Dzugaru 10y agoAre DL-based reinforcement learners that observe the environment and make decisions a "mere pattern recognition" too? What is different about "true" intelligence then? What is major breakthrough? Self-consciousness?
- lngnmn 10y agoNot self-consciousness, perhaps, but artificial instincts would be a next big thing. Imagine that your self-driving car is afraid of self-destruction and takes care of its own fitness by avoiding the holes on the tarmac.) This, by the way, would be a major source of additional feedback for better training. Fear has been evolved for a purpose.
- eva1984 10y agoWrong on so many levels. If AI has been well-researched in 90s, why it is DL that really pushes the boundary of several essential tasks, namely image/speech recognition, machine translation to near human performance? I am curious about your definition of 'AI' that seems only obvious to the term 'Artificial'.
- lngnmn 10y ago> namely image/speech recognition, machine translation to near human performance? The key word here is recognition. Better, faster, more efficient classifiers. The algorithms for training a better representation of the features, not just features itself is a big deal, but it is, again, supervised learning. The adversary approach, which gives additional feedback for better training, is mere sophisticated supervised learning. Take one of the best papers survey (which is an emergent new genre in hipster's blogs) and one will see that there is nothing fundamentally new, apart from sophistication and additional feedback.
- eva1984 10y agoWhile if you consider that human achieves intelligence through a lot of supervision(homework and exams) too, I won't go directly to disclaim only unsupervised learning can be hailed as the king. In fact, there is a discussion about the definition of unsupervised learning, because of the emergence of techniques like word2vec, where it essentially supervised learning but construct all its tasks from the data itself without any labelling.
- p1esk 10y agoYou do realize that main DL ideas have been developed in the 90s, or even earlier? CNNs, RNNs, LSTMs, reinforcement learning, gradient descent, backpropagation - all that was used in the 90s, but given the limited computing power they had, people simply couldn't run large enough models on large enough data to get results.
- eva1984 10y agoWithout development of technique like Dropout Batch normalization, residual connection, better optimizer like Adam, even with enough data and computational power, DL won't be nearly as powerful as it is today.