4 ms·
> The higher the probability, the higher the entropy and the lower the information content. Is this a known and/or understood statement? It seems to be saying
by oriel 10y ago
> The higher the probability, the higher the entropy and the lower the information content.
Is this a known and/or understood statement? It seems to be saying a lot for so few words. Would love any other sources that could expand on it.
- tromp 10y agoIt is known if we fix it to read "the lower the entropy". Information Theory equates entropy with with the (expected) negative logarithm of probability.
- deleted 10y ago[deleted]