4 ms·
"Paragraph" is highly optimistic. IIRC, each English character has about 1 bit of entropy.
by AnimalMuppet 5y ago
"Paragraph" is highly optimistic. IIRC, each English character has about 1 bit of entropy.
- __s 5y agoShannon estimated 0.6 to 1.3: https://cs.fit.edu/~mmahoney/dissertation/entropy1.html https://cs.fit.edu/~mmahoney/dissertation/entropy1.html For the sake of argument I figured I'd be highly optimistic. The linked prize shows practical evidence of 1GB of Wikipedia being compressed below 1 bit per character (& that's with a limit of 50 hours cpu time, 10GB memory, & 100GB disk)