> The signicant aspect is that the actual message is one selected from a set of possible messages > If the number of messages in the set is finite then this nu

> The signicant aspect is that the actual message is one selected from a set of possible messages > If the number of messages in the set is finite then this number [...] can be regarded as a measure of the information produced when one message is chosen from the set, all choices being equally likely. From the abstract of his famous paper http://math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf http://math.harvard.edu/~ctm/home/text/others/shannon/entrop...