3 ms·
Information theory is a tricky beast. Pi contains no more information than it takes to express it, so in information theory terms it doesn't contain much inform
by jerf 16y ago
Information theory is a tricky beast. Pi contains no more information than it takes to express it, so in information theory terms it doesn't contain much information at all since it can be expressed very concisely.
It so happens that pi + enough information to use pi as raw material to produce the desired information can output anything you like, which some people find amazing. But really, "anything + enough information to use 'anything' as raw material to produce the desired output" works equally well, too; pi isn't actually that special either. Also, the information needed to produce your desired output from pi is on average larger than the information in the desired output in the first place, which is why the "compress your things by referencing a digit number in pi" doesn't actually work.
So, pi contains all the information in the world as long as you use more information to extract it from pi, in which case all you are really doing is expressing the original information in a particularly unpleasant encoding.
But it sounds cool to say pi has all this information... "how can anything with an infinite number of normalized digits consist of only a handful of bits?" asks our feeble, mathematics-impaired human minds.
(By the way, this is extended agreement with the post I'm replying to, not any implicit disagreement.)