4 ms·
A bigger-picture "unreasonable effectiveness" article would be "The Unreasonable Effectiveness of Weighted Majority Votes in Machine Learning." This Monday I'm
by j2kun 11y ago
A bigger-picture "unreasonable effectiveness" article would be "The Unreasonable Effectiveness of Weighted Majority Votes in Machine Learning."
This Monday I'm publishing a post on [1] that gives some rigorous explanation for this, which essentially covers the results of this paper [2] whose main theorem is a claim about majority voting schemes.
[1]: http://jeremykun.com/ http://jeremykun.com/
[2]: http://cseweb.ucsd.edu/~yfreund/papers/BoostingtheMargin.pdf http://cseweb.ucsd.edu/~yfreund/papers/BoostingtheMargin.pdf
- bagboost 11y agoThanks, [2] is a very nice paper with intuitive ideas and insights. To summarize it: When the common people agree and few disagree there are great expectations that a generalization is possible and effective.