> there's a very clear, accurate, and formal use of "entropy" to mean exactly what the author purports it doesn't mean: chaos. Shannon didn't define it as "cha

> there's a very clear, accurate, and formal use of "entropy" to mean exactly what the author purports it doesn't mean: chaos. Shannon didn't define it as "chaos" rather as a: "measure of information, choice and uncertainty." http://math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf http://math.harvard.edu/~ctm/home/text/others/shannon/entrop... It also matches what we know: the less "uncertain" some amount of the information the less it is compressible. However he does mention "chaotic" in one sentence, in evaluating the "constraints" imposed by the language when making the crossword puzzles: "If the redundancy is too high the language imposes too many constraints for large crossword puzzles to be possible. A more detailed analysis shows that if we assume the constraints imposed by the language are of a rather chaotic and random nature, large crossword puzzles are just possible when the redundancy is 50%."