3 ms·
Another way of looking at karpierz's comment is through the incompressibility of pure noise at scale. As soon as some infinitely generated sort of noise is fro
by tbalsam 3y ago
Another way of looking at karpierz's comment is through the incompressibility of pure noise at scale.
As soon as some infinitely generated sort of noise is from some subset of possible noise, there is indeed (AFAIK) some kind of an ideal estimator that appropriately compresses that noise source with no bias and less entropy that the full space of possible noise.
I hope this shines an additional alternative light on the topic.
- mitthrowaway2 3y agoI deeply suspect that this has more than surface similarities with the observation that you cannot extract work from a uniform heat bath, but you can extract work from a temperature gradient. There's probably not much an intelligence could learn to predict about its future environment living inside the core of the sun, even if it could withstand those temperatures -- just randomness everywhere in every direction. But on Earth, with the sun shining in and the coolness of space behind us, there are a lot of causal relationships that can be compressed to make useful predictions.
- tbalsam 3y agoThe flow of entropy is a marvelous, strange, bizarre, and beautiful thing.