>Ah. Not read Shannon himself, so wasn't aware he used his own special definition of surprise. You must have missed it then... https://en.wikipedia.org/wiki/E

>Ah. Not read Shannon himself, so wasn't aware he used his own special definition of surprise. You must have missed it then... https://en.wikipedia.org/wiki/Entropy_(information_theory) https://en.wikipedia.org/wiki/Entropy_(information_theory) https://en.wikipedia.org/wiki/Information_content https://en.wikipedia.org/wiki/Information_content https://plus.maths.org/content/information-surprise https://plus.maths.org/content/information-surprise >I'm still not buying that definition of surprise... You don't have to "buy it". I am just telling you that it's the definition used by every person who knows what a bit is. https://en.wikipedia.org/wiki/Bit https://en.wikipedia.org/wiki/Bit