4 ms·
Nvidia uses GAN for video compression
- pkulak 6y agoThis and other ways of using ML for video compression (like DLSS) scare me a bit because it kinda screws with reality. Like, with MPEG compression, you just see less detail when there's less bandwidth and you know exactly what you're missing. But we seem to be moving to methods where instead of removing the missing data, we fill it in with what should most likely be there. There's something that just seems wrong with that.
- glial 6y ago> instead of removing the missing data, we fill it in with what should most likely be there Just like the blind spot caused by your optic nerve!
- rasz 6y agoIt will be fine as long as codecs still encode difference between model prediction/ML hallucination and ground truth. We dont need another Xerox compression fiasco http://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres_are_switching_written_numbers_when_scanning http://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres_...
- glial 6y agoIMO this is a fantastic use of this technology. The bandwidth is low enough to enable videoconferencing on a dial-up connection. I only wonder how big the model is - gigabytes I bet.
- Fronzie 6y agoThe article state that it does send over at least 1 key-frame. That might be used to find coefficients in a much smaller model, similar to how Active Appearance Models approximate a lot of faces with a relatively small model.
- BHSPitMonkey 6y agoExisting discussion: https://news.ycombinator.com/item?id=24694565 https://news.ycombinator.com/item?id=24694565