4 ms·
I compressed it with a simple arithmetic compressor to 4368 bytes (3583 for the guessable words, 785 bytes for the hidden word set), using a zero order model.
by ChrisLomont 5y ago
I compressed it with a simple arithmetic compressor to 4368 bytes (3583 for the guessable words, 785 bytes for the hidden word set), using a zero order model.
I used an arithmetic compressor I wrote long ago at https://github.com/ChrisLomont/ArithmeticCompression https://github.com/ChrisLomont/ArithmeticCompression.
Use 26 symbols, and then just feed all the words, a letter at a time, into the compressor.
Or, if you want to check it more easily, compute the letter entropy - you get the same result.
- urbandw311er 5y agoDo have a link anywhere to a tutorial or documentation as to how this sort of arithmetic compression works? I’d love to learn more.
- ChrisLomont 5y agohttps://www.cs.cmu.edu/~aarti/Class/10704/Intro_Arith_coding.pdf https://www.cs.cmu.edu/~aarti/Class/10704/Intro_Arith_coding...
- urbandw311er 5y agoThanks!