3 ms·
Great history of science reporting, I enjoyed reading it. Errata: The article says "The higher the probability, the higher the entropy and the lower the inform
by jll29 5y ago
Great history of science reporting, I enjoyed reading it.
Errata: The article says "The higher the probability, the higher the entropy and the lower the information content." It should say "the lower the entropy", of course, as the definition of information is the same as the definition of entropy (they are correlated, not anti-correlated): white noise has the lowest probability (it's impossible to predict), the highest entropy and therefore the highest information content, according to Shannon's original Theory of Communication.
- Schiphol 5y ago> according to Shannon's original Theory of Communication But not according to Wiener's notion of information, which is, as both theorists agreed, equivalent to Shannon's up to a change in sign.