4 ms·
Yes, it's a bit ironic that the likelihood principle ("all the evidence drawn from data is summarized by the likelihood function") is something that both freque
by zozbot234 7y ago
Yes, it's a bit ironic that the likelihood principle ("all the evidence drawn from data is summarized by the likelihood function") is something that both frequentist and Bayesian statisticians like to claim as their own. Frequentist statistics is basically Bayesian statistics done with a "flat" prior distribution (where "flat" can depend on how the model is parameterized, however). Seen from this POV, it may be somewhat weird to claim that Bayesian stats has "holes" in it.
- steerablesafe 7y agoYes, the only difference is that in Bayesian stats the biggest hole (priors) is explicit and in your face. In frequentist stat that "flat" prior you mention is implicit and flies under the radar.
- gbrown 7y ago> Frequentist statistics is basically Bayesian statistics done with a "flat" prior distribution I disagree strongly - there’s a huge difference in the kind of inference which is provided by each paradigm. To oversimplify, frequentist statistics constructs decision rules with good properties concerning unknown (but fixed) parameters, while Bayesian statistics uses probability to directly reason about those parameters. Confidence and credible intervals are not the same thing - you’re actually flipping what’s considered fixed and random.
- 08-15 7y agoMaximum likelihood is equivalent to Bayesian maximum a-posteriori (MAP) given a uniform prior and the right choice of parameters. However, decision theory tells us, that MAP estimation is rarely, if ever, a good point estimator. The mean or the median of the posterior distribution is usually better, but the optimal choice may be something entirely different. (Why even consider MAP when it's dumb? Only because it's computationally cheaper than anything else.)