3 ms·
This is pretty much what audio compression, like a MP3 file, does: it figures out how to encode perceptually-identical (or close) stuff more densely and remove
by mlyle 2y ago
This is pretty much what audio compression, like a MP3 file, does: it figures out how to encode perceptually-identical (or close) stuff more densely and remove redundant information.
Every time you listen to "HD Radio" you're doing exactly this.
- vlovich123 2y agoYes, but modern ML techniques (particularly with neural networks) are much more impressive at recovering signal with even less information than things like MP3. An example of this in the visual domain is upscaling. So it’s not a bad question at all.
- mlyle 2y agoSure-- as we've discussed endlessly here: compression and ML are really very close cousins. I never said it was a bad question.
- keithalewis 2y agoYou can even win a prize for that https://en.m.wikipedia.org/wiki/Hutter_Prize https://en.m.wikipedia.org/wiki/Hutter_Prize.
- vlovich123 2y agoI extremely dislike the Hutter Prize. I think it's generally agreed that intelligence compresses the model better & therefore it's reasonable to assume that the better the compression, the more intelligence you have (at least for now where we are with AI, this seems to be a roughly reasonable assumption). My problem with the Hutter prize is that it makes the leap to say that lossless compression is this when everything about AI is choosing how much error you're willing to tolerate. In other words, intelligence is linked to lossy compression, not lossless - a competition for lossless compression doesn't do anything more than get us better lossless compressors / decompressors.