2 ms·
Fabrice Bellard has a project that does precisly this. And does it extremely well, apparently. Previously on HN: https://news.ycombinator.com/item?id=27244004 h
by hnfong 4y ago
Fabrice Bellard has a project that does precisly this. And does it extremely well, apparently. Previously on HN: https://news.ycombinator.com/item?id=27244004 https://news.ycombinator.com/item?id=27244004
Apparently it leads the compression of enwik9 ( http://www.mattmahoney.net/dc/text.html http://www.mattmahoney.net/dc/text.html ) . Not sure why it isn't eligible for the Hutter Prize, there's some speculations in the previous discussion but I don't know whether they're true.
- kragen 4y agoit takes too long to run
- Der_Einzige 4y agoThank you! Turns out that GPT does in fact perform lossless compression if you want it to, like in this demo.
- hnfong 4y agoThe main issue is that most ML frameworks aren't reliably reproducible, and are not designed for such use cases. Bellard's solution was to code up his own neural network library in C.