3 ms·
AI-as-extreme-compression seems like a subfield with a lot of fascinating applications. Kinda like how MP3 used a perceptual model to define what sounds were le
by jes5199 4y ago
AI-as-extreme-compression seems like a subfield with a lot of fascinating applications. Kinda like how MP3 used a perceptual model to define what sounds were least important, AI compression could have a conceptual model of what features were least important
- gcanyon 4y agoI think I've commented on this in the past here. Once you accept non-lossless compression, there's always a trade-off between compression efficiency and fidelity to the original. We're not yet to the point where ET can be compressed as, "a movie about an innocent alien stranded on Earth who gets help from some kids to contact his people for rescue," but we're not too far away from it, either.
- KRAKRISMOTT 4y agoYou can already do this with existing large language models, as long as the entire script can fit into their context vector layer.
- bobkazamakis 4y agostill wrong; can't best information theory yet.
- KRAKRISMOTT 4y agoIf you want to squeeze it into one sentence, obviously it will be lossy. That's the whole point of summarization.