3 ms·
> so wasn't aware he used his own special definition of surprise. All the work I've seen has talked about information or entropy. It isn't 'special', and direc
by _jal 6y ago
> so wasn't aware he used his own special definition of surprise. All the work I've seen has talked about information or entropy.
It isn't 'special', and directly relates to the definition of entropy.
- magicalhippo 6y agoWell guess I've either read sources which avoided that word when defining entropy, or I mentally erased it because of the poor fit.
- ukj 6y ago"Poor fit" is an ironic choice of words. https://en.wikipedia.org/wiki/Goodness_of_fit https://en.wikipedia.org/wiki/Goodness_of_fit Fundamentally statistics is Information theory. https://en.wikipedia.org/wiki/Principle_of_maximum_entropy#History https://en.wikipedia.org/wiki/Principle_of_maximum_entropy#H...