I don't understand, why would "ee" contain less information than "hh"? He's not talking about "information" in the sense of "facts" in this case. Do some readi

I don't understand, why would "ee" contain less information than "hh"? He's not talking about "information" in the sense of "facts" in this case. Do some reading on Shannon entropy for the details, but broadly, take the following example. $ grep -c ee /usr/share/dict/words 10620 $ ^ee^hh grep -c hh /usr/share/dict/words 132 Suppose you're looking for a given word out of some arbitrarily defined set of words, such as a dictionary file. Suppose further you're given either the clue that it contains the sequence "ee", or the sequence "hh". There's a much lower probability of any specific one of the 10000-odd words in the set being the match for "ee" than one of the 100-odd for "hh". In information-theoretic terms, that probability gives you useful data, or information, about the word you're looking for.