3 ms·
>Entropy, an Information Theory term coined by Claude Shannon in 1948, describes the minimum number of bits, on average, needed to encode a dataset. Shannon di
by absoflutely 5y ago
>Entropy, an Information Theory term coined by Claude Shannon in 1948, describes the minimum number of bits, on average, needed to encode a dataset.
Shannon didn't coin the term entropy. He borrowed it from the analogous definition in thermodynamics.