3 ms·
In a Bayesian sense you can calculate the frequency of an event from one occurrence: if it happened once to a city 3600 years ago, you can use that information
by kragen 5y ago
In a Bayesian sense you can calculate the frequency of an event from one occurrence: if it happened once to a city 3600 years ago, you can use that information to update whatever your prior probability distribution was over these event frequencies. Your untutored intuition that this is not enough to give you a very tight distribution is correct, but I think "frequently, perhaps every couple hundred years" is a justifiable description of it.
As dredmorbius points out, we actually have a fairly comprehensive dataset of smaller events we can also use, plus a couple of bigger ones: https://news.ycombinator.com/item?id=28612676 https://news.ycombinator.com/item?id=28612676
A thing to keep in mind is how very few cities there were 3600 years ago. There might have been 10-50 million people in total, the size of a single small town in China today.
- jerrre 5y agoI just had to double check because of your last sentence, but we're not at the point yet that 10-50million is a small town in china: https://en.wikipedia.org/wiki/List_of_cities_in_China_by_population https://en.wikipedia.org/wiki/List_of_cities_in_China_by_pop... here we have 6 cities over 10m.
- kragen 5y agoYes, of course you're right about that.
- dragonwriter 5y ago> In a Bayesian sense you can calculate the frequency of an event from one occurrence: if it happened once to a city 3600 years ago, you can use that information to update whatever your prior probability distribution was over these event frequencies. But your prior probability distribution is either (1) based on a lot of other data, so that the final result is not based on the single data point, or (2) garbage. > Your untutored intuition It wasn't either, thanks, and its arrogant as fuck for you to assume this. > As dredmorbius points out, we actually have a fairly comprehensive dataset of smaller events we can also use I wasn’t commenting on a claim about what could be estimated based on that wider dataset. > A thing to keep in mind is how very few cities there were 3600 years ago. That has no impact on the uncertainty of the estimate from a single data point, only the actual estimate.
- kragen 5y ago> But your prior probability distribution is either (1) based on a lot of other data, so that the final result is not based on the single data point, or (2) garbage. To do Bayesian reasoning at all, you need an initial prior probability distribution based on zero events, and all your posterior results are calculated from it. So if it's really "garbage" you're kind of in trouble regardless of how much data you have. In fact, it's easy to construct priors that cause Bayesian methods to give results that are obviously garbage by any standard even after updated with arbitrarily large amounts of data. This is often used as an argument for preferring frequentist statistics. This is a fairly central aspect of Bayesian statistics: what can you pick as an "uninformative prior" for an unbounded distribution? A uniform distribution over the entire positive number line unfortunately isn't normalizable, so we unavoidably have some kind of falloff as we go to sufficiently low frequencies, and an exponential distribution is the least unreasonable thing to pick. But, if we're completely uninformed and don't know anything about Earth or the universe, we might start with a prior exponential distribution whose median is at "one city-destroying-sized meteor explosion on Earth per nanosecond," not realizing that the Earth would be molten if this happened, or at "one city-destroying-meteor explosion on Earth per googol years", not realizing that the universe is vastly younger than that and in fact meteors do hit occasionally. Then, given the observed data that apparently a city was thus destroyed 3600 years ago, when cities covered maybe 0.001% of the land, and apparently less than ten cities have been destroyed since, and definitely none in the last 200 years even though cities spread to cover 1% of the land, the first of these gives us the posterior "city-destroying meteors happen every few hundred to every few thousand years" (even though it's not "based on a lot of other data" and the prior isn't very similar to that posterior, it succumbs to the evidence of those quintillions of nanoseconds when no cities got destroyed), while the second one gives us a much less reasonable estimate which could reasonably be described as "near infinite error bars" or "garbage". So, in summary: • you can compute the frequency of an event from a single observed occurrence; • your prior does not have to derive from a lot of other data for this, not even the fact that the Earth is not currently molten; • the only Bayesian way to derive a prior probability from a lot of other data is to use a prior that does not derive from any data, so any epistemology that rejects such priors as "garbage" necessarily rejects purely Bayesian reasoning entirely; • such an uninformative prior can be obviously wrong in certain ways, to the point of absurdity, and still give you reasonable inference results; and • these are very elementary facts about Bayesian statistics. In short, the things you are saying are (with respect to Bayesian statistics) as incorrect as claims like "you can't trisect an angle," "you can't subtract 4 from 3," or "3 - 4 = -1 but there's no square root of -1." > > Your untutored intuition > It wasn't either, thanks, and its arrogant as fuck for you to assume this. You evidently didn't know the elementary aspects of Bayesian statistics I explained above, so arrogant as fuck or no, I turned out to be right about that; I'd describe it more as an inference than an assumption. I probably can't teach you anything while you're in ego defense mode, but maybe I can keep you from misleading anybody else. I'm sorry I hurt your feelings, and if there is some way I could have totally dismissed your incorrect opinion without hurting your feelings, please tell me what it is so I can do it in the future. > That has no impact on the uncertainty of the estimate from a single data point, only the actual estimate. Yes, you're right, or very close anyway (since a proper prior for this problem necessarily depends on at least some kind of scale parameter, the shape of the results will vary slightly depending on at least the ratio between that scale parameter and the actual frequency estimate).