5 ms·
I agreed, also I agree that the pro and con of each one isn't stated enough either. I recently attended Dr. Frank Harrell's workshop and he really put the diff
by anthony_doan 7y ago
I agreed, also I agree that the pro and con of each one isn't stated enough either.
I recently attended Dr. Frank Harrell's workshop and he really put the differences between the two from his experiences in perspective.
He advocate more for continuous variable responses than what most ML does. He also put into context what ML does well where the "signal to noise" ratio is so that the noise are little and signal are more. But when the noises are getting bigger statistical model will do better.
His examples is the titanic dataset. Paraphrasing but he stated, "I don't care who live or die." The better question is what is their tendency to live or die? Instead of classifying it into two categories why not give a percentage? What if a person is 49% likely to live? Aren't you playing God? And it is up to the person that's using the model to decide not the modeler. Another case is that it's a loss of information by forcing it into a classification problem.
He went on how ML tend to do this force classification. And how it is very good at things that have low signal to noise, such as game of Go, speech rec, visual rec, etc...
It's an interesting contrast than Dr. Leo Breiman's The Two Cultures paper. At least that's my take away, Dr. Breiman may be less opinionated? Both are very critical of statistic/data models but Dr. Frank Harrell have good remedies and counter points.
- nafizh 7y agoPersonally, I don't agree with a lot of Dr. Harell's definitions for SL and ML to begin with. He mostly talks about clinical trials, a field I don't have much knowledge about. But a lot of the arguments seem to attack a strawman defined as ML.
- anthony_doan 7y agoOh I can see that. I think personally they're just pro and con for both. They're enough problems out there for both of them to coexist. With that said, I think the future of AI is going to be a hybrid of SL/ML as seen on m4 time series competition. ML may be just a stepping stone, like the two AI winter with expert system dying out. Or perhaps ML is going to just advance like NN did and went deep learning. Dr. Leo Breiman is correct in harshly criticizing SL but I believe both sides are going to have to take harsh objective criticisms for them to move forward.