3 ms·
Why is it called machine learning while it is actually normal statistics and control theory? There isn't anything in there that learns, there is only a data mo
by AstralStorm 10y ago
Why is it called machine learning while it is actually normal statistics and control theory?
There isn't anything in there that learns, there is only a data model and a strict algorithm.
It should rather be called Data Mining.
- markovbling 10y agoThere is learning - the model is learnt from the data
- markovbling 10y agoThat is normal statistics though to be fair
- eanzenberg 10y agoI mean, that is all 'machine learning' and AI anyways. Whoever renames the methods probably does so for additional funding, and this technique is not exclusive to ML research.
- wodenokoto 10y agoFitting is called training and when you look at it this way, your algorithm gets better and better at some task the more you train it.thus with practice your algorithm learns. It's just semantics. So how is it different from statistics. It isn't, but usually the focus in ml is on big data and the accuracy of the prediction, while statistics tend to focus more on the explanation of the data. I believe the reason for the difference is one sprang out of computer science and revived research into AI and therefore is more hip. The other didn't and is still fighting with its image of being dry and boring.
- AstralStorm 10y agoNot at all. Actual AI starts when the exact structure of the model is not known to the author. This is the realm of free form Hidden Markov Models, Support Vector Machines, Restricted Boltzmann Machines and variants of neural networks. Also certain clustering algorithms e.g. kernel projections. Where the structure of such model depends on training data and is not chosen by the programmer ahead of time. (Manually structured NNs, RBMs and HMMs do not really count.)
- JFrolich 10y agoActually all these models are just variations of well known statistical models (or can be derived as such). For instance support vector machines is the same as logistic regression with a slightly different loss function and regularization. Clustering is also a well know subject of statistics (in machine learning often referred to as unsupervised machine learning). Deep learning is 'just' stacking different models on top of each other hoping to capture more abstract concepts. Very cool but at this point there is not a good mathematical explanation why this works so well. A lot of stuff is the same between machine learning and statistics with different terminology. With machine learning often more focussing on the practical side rather the theoretical side (or the real probabilities). It's good to cross pollinate and learn from each other. Such as the machine learning field learning to create better models with Bayesian statistics, and statisticians learning from models like support vector machines. I also look forward to more mathematicians and statisticians exploring deep learning, and finding more rigorous scientific explanations why they work so well (and this can help us making them even better). (I come from an Econometrics background, but wrote my master these about machine learning).
- deleted 10y ago[deleted]
- bane 10y agoMachine Learning is the latest discipline to become a relabeled and conflated Statistics now that Data Science is old news. They used to be separate disciplines, but for some reason Stats keeps looking for a separate label to glom onto in a similar way that Ontologies used to glom onto every sexy new technology in sight. In this light, most Machine Learning is just a rebadging of Classification theory that sounds cooler. Somewhere in the future, ML will fall off the hype curve [1] and something new will come along for boring old disciplines to rebadge themselves as. The good news is that these disciplines all leave bits of themselves behind and the things they were pretending to be become better and better defined. It's amazing how few job posting for Data Scientist require a PhD a Stats these days, but it was all the rage for a year or two. Now a reasonable Data Scientist can train up on Corsera in a few weeks. 1 - http://4.bp.blogspot.com/-eL79PoJLFVY/UfSulEQrdfI/AAAAAAAAAws/fgUPqnFZ0a0/s640/Gartner's+Hype+Curve+Breakdown.JPG http://4.bp.blogspot.com/-eL79PoJLFVY/UfSulEQrdfI/AAAAAAAAAw...
- ma2rten 10y agoYou are right it's marketing for a large part. The term Machine Learning somehow implies that the algorithms are more intelligent (or even sentient) then they actually are. That said, Machine Learning is different from statistics. Statistics are mostly concerned with modeling real world phenomena. Machine Learning is trying to build models that can take a training set and generalize to unseen data without building a specific model for that dataset.
- RockyMcNuts 10y agoThere both about inference, just slightly different philosophical approaches. Statistics, dating before computers and big data, comes out of math, has a greater emphasis on proofs and closed form solutions, and IMO an opinionated view that what it's modeling is a well-behaved function plus a well-behaved error term. Machine learning is kind of like statistics for street-fighting. It doesn't care about Bayesian v. frequentist philosophical debates, resorts to cheap tricks like regularization, dropout, using many dumb methods that work better than trying to find the smartest method (ensembles and funny tricks like random forest). If it works in a well-designed test, use it. There is more than one path to enlightenment. One man's 'data mining' is another's reasoned empiricism, letting the data do the talking instead of leaning on ontological preconceptions of how data is supposed to behave. Machine learning often works well but you don’t always know why. Stats doesn’t always work and you know precisely why not. (because your data doesn't fit the assumptions of OLS etc.)
- achompas 10y agoI take issue with a number of points in your post, as they don't characterize the differences in the disciplines properly. > There both about inference This is actually incorrect -- a large swath of machine learning algorithms (like deep learning and SVMs) are unconcerned with the underlying distribution of your data, and are perfectly happy to generate predictions using a completely uninterpretable model. > Statistics [...] comes out of math, has a greater emphasis on proofs There is an entire branch of machine learning, known alternatively as learning theory or complexity theory, devoted to the analysis of algorithmic generalization error. Generally speaking, any popular machine learning algorithm has a proof of its (1) performance and (2) ability to generalize. > It doesn't care about Bayesian v. frequentist philosophical debates If this is true, it's only because machine learning has firmly parked itself in the Bayesian camp wherever possible. Naive Bayes, regularization, dimensionality reduction, and graphical models are either motivated by or easily interpreted as Bayesian techniques.
- RockyMcNuts 10y agowhat's your definition of inference, and what do you call the purpose of a machine learning algorithm, and how does that purpose differ from a statistics approach? perhaps I used the term incorrectly but a dictionary defines inference as "a conclusion reached on the basis of evidence and reasoning." bottom line... similar objectives, slightly different if often overlapping emphases and bags of tricks.