3 ms·
Anyone interested in this approach to lossless compression should visit (and try to win!) Hutter Prize website[1][2]. The goal is to compress 1GB of english wik
by ithinkso 7y ago
Anyone interested in this approach to lossless compression should visit (and try to win!) Hutter Prize website[1][2]. The goal is to compress 1GB of english wikipedia
[1] http://prize.hutter1.net/ http://prize.hutter1.net/
[2] https://en.wikipedia.org/wiki/Hutter_Prize https://en.wikipedia.org/wiki/Hutter_Prize
- londons_explore 7y agoI don't think anyone has yet applied neural net approaches to the hutter prize with success. The trained neural network weights tend to be very large, and hard to compress, and the hutter prize requires the size of them to be counted too. To win the hutter prize, you'd probably need some kind of training-during-inference system.
- sbierwagen 6y agocmix uses a LTSM net: http://www.byronknoll.com/cmix.html http://www.byronknoll.com/cmix.html
- m463 7y agoI wonder if a larger initial dataset (say 5G or 10G) might lead to better overall % compression.