3 ms·
The textbook I first learned it from described entropy as the amount of uncertainty associated with the event[1]. I don't remember whether it tried to form an e
by kd0amg 16y ago
The textbook I first learned it from described entropy as the amount of uncertainty associated with the event[1]. I don't remember whether it tried to form an explicit link to "bits" in the sense of "amount of computer memory/storage." Perhaps you could trick people into not getting confused by using another name at first and then later showing the conversion from uncertainty measured in [other-unit-name] to the minimum average number of bits to encode the outcome is the identity function.
[1] It helped that the book gave axioms for uncertainty and then derived the -sum(p*log(p)) formula.