11 ms·
You could, but I don't think this would be competitive on compression ratio at all, even allowing for an order of magnitude more time.
by vintermann 10y ago
You could, but I don't think this would be competitive on compression ratio at all, even allowing for an order of magnitude more time.
- sp332 10y agoThe technique is very effective, after all a variant of paq holds a compression record. http://prize.hutter1.net/ http://prize.hutter1.net/ You can try paq yourself in PeaZip. http://filehippo.com/download_peazip_64/ http://filehippo.com/download_peazip_64/
- argonaut 10y agoPAQ does not use autoencoders, that's the difference. Neural network models for compression are extremely slow and can use a crapton of memory (one top benchmark result uses 32GB of RAM): https://www.quora.com/What-is-the-potential-of-neural-networks-in-data-compression https://www.quora.com/What-is-the-potential-of-neural-networ...
- vintermann 10y agoLast I checked, PAQ only uses a shallow (two layer) neural network as a last step to weight the predictions from the multiple handmade next-bit prediction models it contains.
- sp332 10y agoSo, you think the additional accuracy of the larger neural network isn't enough to overcome the storage size of the network itself?