3 ms·
Absolutely, yes. There is a very deep link between compression and "understanding". I think we have every reason to believe that networks that can understand/"e
by joeyo 10y ago
Absolutely, yes. There is a very deep link between compression and "understanding". I think we have every reason to believe that networks that can understand/"explain away" the content/statistics of a scene ought to be able to compress them better.
I presume someone (or likely many people) are working on exactly this.
- Stanleyc23 10y agoVery cool! if anyone who comes across this particular thread knows about papers/research being written about this topic, I'd be very interested to learn more.
- sapphireblue 10y agoThere is an award-winning compressor that uses many statistical models (and a 3-layered dense neural network) to compress the data losslessly: http://www.byronknoll.com/cmix.html http://www.byronknoll.com/cmix.html Also there is a free book that contains descriptions of various common and exotic compression formats http://www.mattmahoney.net/dc/dce.html http://www.mattmahoney.net/dc/dce.html Overall I think we are yet to see the full potential of deep learning unleashed on data compression. For example the neural network in cmix compressor is quite primitive compared to modern architectures. Someone will certainly find a way to do better than that!
- Stanleyc23 10y agoah thanks. really appreciate the lead. do you yourself happen to have much experience in the space of machine learning or compression?