5 ms·
"Where does all that 'entropy' come from?" Your scare quote suggests you may already know this, but for the benefit of others, the answer is that there isn't a
by jerf 10y ago
"Where does all that 'entropy' come from?"
Your scare quote suggests you may already know this, but for the benefit of others, the answer is that there isn't any. Fractals may look visually complicated, but their information content is fully captured by the routines used to generate them, which include the formula and the coloring system being used.
This is one of the ways in which "information" is a highly counter-intuitive quantity for people. Very small numbers of bits in a given encoding scheme can produce incredibly complicated pictures, but there's still no more information that what was put in to start with. Simply looking at something and going "Yup, that's complicated" does not mean it has a lot of information in it.
- wyager 10y agoYes, that is what I mean. Why is there a disconnect between the complexity of the compact description and the naive description? Why are simple expressions not simple in all "natural" representations? This is not addressable with the contrived example of "you can create an encoding scheme that reduces an arbitrarily complex description to an arbitrarily short identifier". After all, this is not a constructed compression scheme. Why does nature expand simple expressions to these particular complicated forms?
- schoen 10y ago> Why are simple expressions not simple in all "natural" representations? Another example might be the primes, which have a very simple description and very subtle structure in their distribution.
- qubex 10y agoI don't really agree that the primes “have a very simple definition” in that the notion of ‘primeness’ is one of satisfiability and no constructive algorithm is known to exist.
- Chinjut 10y agoI'm not sure what you're getting at here. Is it not relevant that there is a simple algorithm to enumerate the primes, or, even more so, determine whether a given value is prime?
- spacehome 10y agoOf course it's relevant. qubex is just confused.
- jerf 10y agoI'm not sure what you mean by not having a constructive algorithm to produce primes. The Sieve of Eratosthenes will output any given prime, with the primes coming out in order, given enough time. There may not be an efficient algorithm, but for most definitions of "information" that won't matter. The sequence of all primes is both so richly structured we've probably only scratched the surface and almost entirely bereft of information.
- qubex 10y agoYup you're right and I'm wrong.
- gerbilly 10y ago> Why are simple expressions not simple in all "natural" representations? I think because that simple description describes a non-linear iterative process that feeds back on itself.
- lmm 10y ago> This is not addressable with the contrived example of "you can create an encoding scheme that reduces an arbitrarily complex description to an arbitrarily short identifier". After all, this is not a constructed compression scheme. Why does nature expand simple expressions to these particular complicated forms? If not these particular forms then it would be some others. That fractals exist is pretty-much the fact that pseudo-random number generators exist: you plug in a small amount of input and it generates noise. The fact that it looks like something is more a sign of the overactive human facility for pattern recognition than anything else. (Also I suspect it would look a lot less like a burning ship if we hadn't been told it was a burning ship)
- nikki93 10y agoWell I think there is a lot of complexity in the interpreter of the math string. For example, imagine I write an interpreter that takes a single character, and if it's 'A' gives a mandelbrot fractal, 'B' a burning ship fractal, 'C' an image of the sun that is hardcoded into the program (what's the difference between such hardcoding of information and the 'hardcoding' of how multiplication is performed, anyways?) <-- Here is a program that has a lot of 'complexity' produced with only 3 possible inputs. My point is basically, the system includes the interpreter all the way up to the eye and the mind, and it seems tricky to completely detach such context from a description of how 'complex' things are.