Whenever there is an entropy, it can be defined as S = - sum_n p_n log( p_n ) where the p_n is a probability distribution: for n = 1...W, p_n >= 0 and sum_n p

Whenever there is an entropy, it can be defined as S = - sum_n p_n log( p_n ) where the p_n is a probability distribution: for n = 1...W, p_n >= 0 and sum_n p_n = 1. This is always the underlying equation, the only thing that changes is the probability distribution.