5 ms·
>> In the business world, machine learning often goes by the annoying moniker of “artificial intelligence.” That science-fiction buzzword evokes visions of godl
by YeGoblynQueenne 8y ago
>> In the business world, machine learning often goes by the annoying moniker of
“artificial intelligence.” That science-fiction buzzword evokes visions of
godlike sentient computers, when in fact, the product is much closer to a
statistical regression. Machine learning is about using algorithms to predict
things — whether a web-security image contains a cat, what a Google user wants
to search for, or whether a self-driving car should brake to avoid a crash. No
one yet knows how to give a single computer system the mental flexibility to
reason and learn like a human being.
While the last senetence is true, the rest of the opening paragraph of this
article commits the typical sin of promulgating a reductionist definition of
"machine learning", probably because of a lack of historical perspective into
the origins and the use of the term.
Historically, then, the broadest definition of "machine learning" is the one
given by Tom Mitchell, according to whom a machine learning system is one that
can improve its behaviour over time. This covers machine learning algorithms
that are really nothing like statistical regression- decision tree learners,
or the wide array of algorithms and systems that learn logic-based
representations that predominated in the early years of the discipline (and
are still going, if I may, with Inductive Logic Programming).
In short, neither prediction, nor statistical regression are necessary or
sufficient characteristics of machine learning. Indeed, there is nothing
stopping a system that would learn to reason from examples from being categorised as a
"machine learning system".
Nothing- except the incomplete understanding of experts from other
disciplines, perhaps, like the author of this piece.
- cs702 8y agoExactly. I would add that the OP is motivated, in part, by Corporate America's current understanding of "AI" as little more than "glorified regression" and "glorified classification." There's a tremendous amount of hype, but really very little understanding outside of a few academic centers and Silicon Valley companies.
- skywhopper 8y agoThis is exactly the point of the article. If you can let go of your attachment to the academic meaning, the hype long ago was a done deal, and so the responsibility of the business press is to call BS on what the business world says about ML and AI.
- deleted 8y ago[deleted]
- yters 8y agoI've studied machine learning a fair amount, and the algorithms are fancier, but it's still all model fitting by minimizing error. Regression is also model fittining (polynomials) by minimizing mean squared error. Not a huge difference...
- kgwgk 8y agoBut they have invented gradient descent! /s
- YeGoblynQueenne 8y ago>> I've studied machine learning a fair amount, and the algorithms are fancier, but it's still all model fitting by minimizing error. That's only true if you define machine learning as "model fitting", however there are many algorithms and techniques that have nothing to do with fitting a curve to data points and are very commonly considered to be machine learning. E.g. decision tree learners, nearest-neighbour algorithms, Bayesian inference algorithms, Expectation-maximisation (and friends), clustering algorithms- none of these really um fit under "curve fitting", although of course you can broaden the scope of what is meant by "model fitting" to include potentially anything that looks kinda like it from a few steps away. Then of course there is the very broad family of logic-based machine learning systems, pioneered by Ryszard Michalski and others in the '70s and Inductive Logic Programming, that learn logic theories from relational data and do not perform optimisation or model fitting (they tend to be greedy). Basically, it's mostly the gradient-descent based algorithms that do curve fitting (linear regression, perceptrons, SVMs and, er, that; oh, and gradient boosting). These approaches are currently dominant but that's all. There is much more to machine learning than curve fitting.
- pas 8y agoAll of those require a training step, and that is the same error minimization as curve fitting. Basically they are curve fitting in a high enough dimension. Even theory builders can be thought of as curve fitters. The error metric is greedy, the curve is not differentable, but that's it. That said, of course there is much more to it, than training. (And as we saw with OpenAI's dota bots and DeepMind's AlphaGo Zero, with good feature engineering, adversarial learning setup, beating human performance is only a matter of processing power.)
- skywhopper 8y agoWhen the likes of Google, Uber, and Tesla hype “machine learning” as the solution to all problems, then the historical reality of the academics who named it doesn’t really matter anymore. If the press and the financiers believe it’s a silver bullet then the only way to fight that misconception is to use their own terms.