3 ms·
> ... but would I be right in thinking that the probability of a normal, infinite number containing a given arbitrary string of digits is "almost sure" rather t
by lutusp 14y ago
> ... but would I be right in thinking that the probability of a normal, infinite number containing a given arbitrary string of digits is "almost sure" rather than "sure"?
No. Given the assumptions (a normal number, therefore infinite in extent), the probability that a given finite sequence appears somewhere in it is 1.0.
> Or can it actually be proven mathematically that it contains such a string?
Here's one way to think about it. Let's say that you flip a perfectly fair, random coin, heads counts as 1 and tails 0, and each flip adds a bit to a sequence. Let's further say that some finite bit sequence is chosen as a finite-subsequence target, let's say the text of "War and Peace" by Leo Tolstoy (a famously big book, 1,225 pages).
We can agree that, as the normal bit sequence increases in length, the probability of encountering "War and Peace" within the sequence increases as a strict function of the number of bits in the sequence.
Now the clincher -- what is true for a finite sequence (that the probability of encountering a given subsequence increases but never becomes certain) is not true for an infinite sequence. For an infinite sequence, the probability for the appearance of a given subsequence becomes certain, i.e 1.0. The only requirement is that the subsequence be finite.
- dagw 14y ago"almost sure", in probability, means an event with probability 1.0. I realize this is somewhat counter-intuitive from an English point of view, but it makes sense from a Math point of view.
- lutusp 14y agoI just looked into this, and to me it represents philosophy masquerading as logic. Reasonable people may differ. http://en.wikipedia.org/wiki/Almost_surely http://en.wikipedia.org/wiki/Almost_surely A quote: "In probability theory, one says that an event happens almost surely (sometimes abbreviated as a.s.) if it happens with probability one." This is like saying a dollar is approximately 100 pennies, or every woman is approximately pregnant (or the reverse). Another quote: "Equivalently, we can say an event E happens almost surely if the probability of E not occurring is zero." With probability theory being guided by notions like this, no wonder insurance is so expensive. To me, it is to probability theory what post-modernism is to literature -- it reduces everything to a matter of opinion. In analysis, we have the notion of a limit, the idea that we can say something about a quantity that is only approached, never reached. Example: lim x -> 0, 1/x = ∞ Technically this says "as x approaches zero, 1/x approaches infinity." But I can't tell you how many times I have heard this stated as "as x approaches zero, 1/x equals zero." But that's not so -- division by zero is undefined, so the problem as stated can never be described as anything but a limit, an approach. The reverse logic applies to a probability of 1.0 -- 1.0 is not approximately anything, it's 1.0. It's not "almost one", it's "one". And if you subtract one from it, the result is not almost zero, it's zero. > but it makes sense from a Math point of view. Only if probability theory transcends the axioms of logic, and with the assumption that logic is the foundation on which mathematics is built.
- cdavid 14y agoYou're confused about the meaning of almost surely, and your comparison with dollars and pregnancy is misleading. The almost does not apply to the probability being one, but to the meaning of of P(S) = 1 for S a member of your sigma-algebra. So when one says that a real number is almost surely normal, it means P({a is normal; a is real}) = 1, but it does not mean that any real is normal. Indeed, there are infinitely many non normal numbers (for example, every integer is obviously not normal), even though the probability that a number is not normal is 0. In the case of finite probability spaces, this usually does not happen, because for two finite sets A and B, #A != #B usually implies P(A) != P(B) [1], which is why your comparison with pennies/pregnancy is misleading. [1] it is certainly possible to build probability spaces on finite sets where P(A) == P(B) and #A != #B.
- lutusp 14y ago> You're confused about the meaning of almost surely ... Yes, but I'm not the only one. I think most people who read the justification for describing p = 1.0 as "almost surely" will have the same reaction, regardless of their training. Not to argue that logic must accept responsibility for our confusion. > your comparison with dollars and pregnancy is misleading. As to dollars, yes (because it's finite and trivial), but as to the parturient state of a set of women, it depends on the size of the set. For an infinite set of women, to describe them all as almost surely pregnant (or not), is a reasonable corollary to describing p = 1.0 as "almost surely" in the general case. > Indeed, there are infinitely many non normal numbers (for example, every integer is obviously not normal), even though the probability that a number is not normal is 0. This compares two infinite sets and draws a conclusion based on the outcome (the set of integers is infinite in size, and the set of numbers (reals and integers) is also infinite in size). I'm not sure this is comparable to making a statement about the mapping of a single well-defined probability (for example the appearance of War and Peace) into a single infinite set, like the presumed infinite set of the digits of Pi. Which leads to an obvious question -- does the "almost surely" qualifier apply to all p = 1.0 probabilities, or only a subset? In other words, does the qualifier depend on the construction of the probability, or does it always apply?
- gabemart 14y agoThanks for the explanation. While I have no doubt you're right (because I am completely outside my field of expertise), I have difficulty intuitively accepting the answer. By way of comparison, the wikipedia entry on the infinite monkey theorem [1] refers to the probability of producing the Shakespeare corpus as "almost sure", a situation that seems broadly analogous to the one you describe. I suspect the difference is that the monkeys are required to produce an output which is merely random rather than evenly distributed. [1] http://en.wikipedia.org/wiki/Infinite_monkey_theorem http://en.wikipedia.org/wiki/Infinite_monkey_theorem
- lutusp 14y ago> I suspect the difference is that the monkeys are required to produce an output which is merely random rather than evenly distributed. Perhaps, or the fact that probability theorists regularly describe a probability of 1.0 as "almost certain", a wording that to me contradicts common sense: http://en.wikipedia.org/wiki/Almost_surely http://en.wikipedia.org/wiki/Almost_surely
- jasomill 14y agoOf course it does. It's similarly unreasonable to call a Möbius Strip with a disc attached along the boundary circle a "plane"[1], the surface of Cartesian (x, y) coordinates a "line"[2], and numbers having counterintuitive special features, "normal". [1] http://en.wikipedia.org/wiki/Real_projective_plane http://en.wikipedia.org/wiki/Real_projective_plane [2] http://en.wikipedia.org/wiki/Complex_line http://en.wikipedia.org/wiki/Complex_line
- JadeNB 14y ago> numbers having counterintuitive special features, "normal". I don't think that 'normal' implies 'intuitive', even in normal usage.
- Evbn 14y agoAny technical field has to define more concepts than can be distinctly named by casual vocabulary using their plain England meaning, so some words will be jargon. Don't pick on "almost sure". We also have group, ring, field, ideal, prime, countable, closed, ....