3 ms·
Can they trade off storage for compute by applying ML based compression JIT?
by robertk 4y ago
Can they trade off storage for compute by applying ML based compression JIT?
- bsedlm 4y agoprobably not cuz I'd imagine they want lossless compression (given as they don't understand the data well enough to do meaningfull (lossless) compression)
- bsedlm 4y agoI meant: meaningfull (lossy) compression
- whimsicalism 4y agoYou can get very good lossless compression with ML models, it is just not very fast to decompress.
- davidatbu 4y agoAre you referring to the work of Fabrice Bellard? I thought he only showed the proof of concept for text data, using language models, only?
- whimsicalism 4y agoI am referring to the work by Fabian Mentzer and related approaches, which covers both lossless and lossy compression.
- davidatbu 4y agoJust saw this. Thanks!
- bsedlm 4y agohttps://bjlkeng.github.io/posts/lossless-compression-with-latent-variable-models-using-bits-back-coding/ https://bjlkeng.github.io/posts/lossless-compression-with-la... ?
- whimsicalism 4y agoWas thinking of work like https://arxiv.org/pdf/1811.12817.pdf https://arxiv.org/pdf/1811.12817.pdf although the compression improvements vs classical methods are much more impressive for lossy compression