3 ms·
"It is a tool for exercising discipline, so that you know when you have to say "sorry, not enough data for a meaningful answer"." As opposed to the frequentist
by mcguire 7y ago
"It is a tool for exercising discipline, so that you know when you have to say "sorry, not enough data for a meaningful answer"."
As opposed to the frequentist approach of saying, "We have data D and hypothesis H. If the probability of D when not-H is true is below a threshold, H is true," which hides an awful lot of assumptions.
The advantage of Baysian statistics is that you have to explicitly state your assumptions in terms of a prior.
- BeetleB 7y ago>As opposed to the frequentist approach of saying, "We have data D and hypothesis H. If the probability of D when not-H is true is below a threshold, H is true," which hides an awful lot of assumptions. My textbook (what would be called a frequentist book) is very explicit: You either reject the null hypothesis, or you fail to reject the null hypothesis. A significance level test never concludes that the null hypothesis is true. It's nuanced, but is not quite the same as your statement.
- pdonis 7y agoYes, and under this description, the equivalent of the Bayesian prior is picking what the null hypothesis is. Frequentists simply fail to admit (or perhaps fail to understand) that that choice is just as much of a subjective judgment as the Bayesian choice of prior.
- BeetleB 7y ago>Frequentists simply fail to admit (or perhaps fail to understand) that that choice is just as much of a subjective judgment as the Bayesian choice of prior. Again, this claim is something I see only from self described Bayesians. I've not met a professional statistician ever fail to admit it. My textbook (written in the 90's), in at least two places, talks about it. In one place it explicitly warns against assuming the "traditional" approach is more objective, and points out that the assumptions exist in the model and the practitioner should be aware of those assumptions. And really, when it comes to p-values, I've never seen any stats textbook not give a proper description and interpretation. No statistics textbook I've read describes significance testing as a mere prescription from which you can deduce binary answers. My book discusses factors in picking your p values, and the implications, and that the appropriate value is very dependent on the problem.
- pdonis 7y agoI didn't say "picking the p-values". I said "picking the null hypothesis". (Although p-value hacking is certainly a major contributing factor to the replication crisis.) It's good that the textbooks you were taught from point out that assumptions exist and should be acknowledged.
- BeetleB 7y ago>It's good that the textbooks you were taught from point out that assumptions exist and should be acknowledged. Have you found a "standard" text book that doesn't? Not a probability textbook, but a statistics one.
- harry8 7y ago"Again, this claim is something I see only from self described Bayesians." The claim is that the prior is subjective and they're bad. The Bayesians are drawing the analogy that frequenteist assumptions are just as subjective (but maybe less explicit) to the prior selection so objecting to one and not the other is... ...in need of further justification.
- BeetleB 7y ago>The claim is that the prior is subjective and they're bad. The only such claims I've seen are ones where they disagree with the prior, which is no different that disputes amongst themselves where so-called frequentists argue whether p=0.05 or p=0.001 is appropriate. Frequentists don't pretend that their p-value is set in stone. Let me repeat what I said in another comment: I'm finding this whole discussion orthogonal to Bayesian vs frequentist statistics. The main issue frequentists have with a lot of Bayesian approaches is that Bayesians often want to assign probabilities to one off events, whereas frequentists insist only on repeatable events. That is where the accusation of "subjective" comes from. Frequentists like to believe that any question of probability can be decided by taking N samples and seeing the outcome (even if only conceptually). For problems where there is a population, and one can do sampling (i.e. repeatability), there's never a problem with using Bayesian methods. My complaint is that while there are differences amongst Bayesians and frequentists, this article does not present any, and wrongly implies things about frequentists.