3 ms·
Bayesian probability cannot always be interpreted as a frequency. For example, one could assign a bayesian probability to the extra-terrestrial origin of life.
by kgwgk 10y ago
Bayesian probability cannot always be interpreted as a frequency. For example, one could assign a bayesian probability to the extra-terrestrial origin of life. It wouldn't make much sense to think of it as a frequentist probability: one can easily imagine playing the future several times, but it's not so easy when dealing with the past.
And statistics is not just probability. Frequentist inference is based on procedures that "behave well" in the long term, but may or may not make sense for the particular outcome at hand.
For example, a 95% confidence interval calculated using a procedure that guarantees that the interval contains the true value 95% of the time may yield an interval that cannot contain the true value (for example the interval covers only negative values and the true value is known to be positive). See http://learnbayes.org/papers/confidenceIntervalsFallacy/ http://learnbayes.org/papers/confidenceIntervalsFallacy/ for a discussion of confidence intervals.
Another issue is related to how the "possible outcomes" are defined. For example, a frequentist analysis of the fairness of a coin after getting four heads and then a tail will be different depending on whether we decided to throw the coin until getting a tail or we had fixed beforehand the number of trials. Look for "stopping rules" or "optional stopping."
- hacker42 10y agoWhat would you respond to my other comment downthread? https://news.ycombinator.com/item?id=11985863 https://news.ycombinator.com/item?id=11985863
- kgwgk 10y agoIf you are able to think of the different realities that would lead to us having this discussion today, some of them with life being originated on planet Earth and some of them with life coming from elsewhere, and you're able to reason about the relative frequency of these two kinds of realities, you definitely have more imagination than me. And I don't know what do you gain with that. Does your frequentist interpretation have a physical meaning? I could assign a Bayesian probability to panspermia, and you could assign a different probability. Is there, according to your equivalent definition in terms of frequencies, a "correct" probability?
- hacker42 10y agoIt is already acknowledged that the initial guess can be wrong. We don't need to consider all possibilities to come up with a prior distribution because that is basically the 'trick' of the Bayesian updating scheme: Just start somewhere and we'll get closer to the true distribution by collecting more data and by using it the most logical way, namely by solving for the posterior. No imagination needed. It is more efficient to distribute the initial probability mass according to our best guess using a lot of imagination, but that itself is basically Bayesian updating because human reasoning is approximately Bayesian (or Bayesian with a noisy prior/bias). A physical interpretation might be that all the other realities are realized in terms of the Many-worlds interpretation or in terms of Tegmark's level 4 multiverse. Without much information we cannot really nail down which reality we find ourselves in (cf. the sleeping beauty problem and Boltzmann brains). But we can use Bayesian updating to become more certain about what reality is about. What do I gain from that? I am not entirely sure, but I find a probability is just better interpretable as frequency or fraction compared to a subjective quantity.