Ah, well, this kind of information--entropy--isn't really the same thing as meaningful information (semantic information). After all, take a dictionary. Lots o

Ah, well, this kind of information--entropy--isn't really the same thing as meaningful information (semantic information). After all, take a dictionary. Lots of meaningful information there. But a lot less entropy than a random sequence of characters of the same length. That random sequence will have a lot more "information", like you said; its a real needle in the haystack, but its all haystack and no golden thread.