6 ms·
Assuming the text is well written, from the standpoint of information theory, the better the text gzips the fewer information it contains
by abriosi 5y ago
Assuming the text is well written, from the standpoint of information theory, the better the text gzips the fewer information it contains
- abriosi 5y agoWe could also argue that an understandable text has a high degree of redundancy, e.g. explaining the same concept with different perspectives
- crznp 5y agoThis comment only uses the ten hundred most used words and "xkcd" to give back love. Writing that uses such a small set of words will probably be easy to make smaller when you save it. And for young students, it might help to have clear, simple writing because they don't have to learn new words too. It might be too simple for older students (or people here). I would like to be able to name new ideas, and it sounds better if I don't have to use the same words over and over. The idea is the same, just relaxed a little bit. Give it a try, it makes you think about writing in a different way. https://splasho.com/upgoer5/ https://splasho.com/upgoer5/
- tachyonbeam 5y agoI would say you can make your text easier to understand by a large audience by avoiding very rare words that many people don't understand, and sticking to common phrasings. That will make text compress better for sure. I'm sure you get literary brownie points for using 10 different words that mean pretty much the same thing in different contexts, but you should never do that in an engineering textbook, for instance.
- jonnycomputer 5y agoAh, well, this kind of information--entropy--isn't really the same thing as meaningful information (semantic information). After all, take a dictionary. Lots of meaningful information there. But a lot less entropy than a random sequence of characters of the same length. That random sequence will have a lot more "information", like you said; its a real needle in the haystack, but its all haystack and no golden thread.