5 ms·

Yeah, if it were actually adopted as a way to do compression, it seems likely to lead to even worse problems than JBIG2 did https://news.ycombinator.com/item?id

Yeah, if it were actually adopted as a way to do compression, it seems likely to lead to even worse problems than JBIG2 did https://news.ycombinator.com/item?id=6156238 https://news.ycombinator.com/item?id=6156238 Invisibly changing the content rather than the image quality seems like a really concerning failure mode for image compression! I wonder if it'd be possible to use SD as part of a lossless system - use SD as something that tells us the liklihood of various pixel values given the rest of the image and combine that liklihood with a huffman encoding. Either way, fantastic hack, but we really should avoid using anything lossy built on AI for image compression.

pishpash 4y ago
Give it "enough" bits and it won't be a problem. How many is enough is the question.
eloisius 4y ago
Imagine a world where bandwidth constraints meant transmitting a hidden compressed representation that gets expanded locally by smart TVs that have pretrained weights baked into the OS. Everyone sees a slightly different reconstitution of the same input video. Firmware updates that push new weights to your TV result in stochastic changes to a movie you've watched before.
- kybernetikos 4y ago
  "The weather forecast was correct as broadcast, sir, it's just your smart TV thought it was more likely that the weather in your region would be warm on that day, so it adjusted the symbol and temperature accordingly"
- jacobr1 4y ago
  You could still use some kind of adaptive huffman coding. Current compression schemes have some kind of dictionary embedded in the file to map between the common strings and the compressed representation. Google tried proposing SDCH a few years using a common dictionary for wep pages. There isn't any reason why we can't be a bit more deterministic and share a much larger latent representation of "human visual comprehension" or whatever to do the same. It doesn't need to be stochastic once generated.
- supergnu 4y ago
  I mean, that is already happening. Almost all modern TV's do some signal processing before outputting the pixels, and the image looks slightly different on each model. But it'd definitely be cool to have some latent representation of a video that then gets rendered on tv - you could apply latent style sheets to the content, like what actors you want to play the roles, or turn everything into a steam-punk anime on the fly. The more abstract the representation, the more interesting alterations you could apply

pishpash 4y ago

Give it "enough" bits and it won't be a problem. How many is enough is the question.

eloisius 4y ago

Imagine a world where bandwidth constraints meant transmitting a hidden compressed representation that gets expanded locally by smart TVs that have pretrained weights baked into the OS. Everyone sees a slightly different reconstitution of the same input video. Firmware updates that push new weights to your TV result in stochastic changes to a movie you've watched before.

kybernetikos 4y ago
"The weather forecast was correct as broadcast, sir, it's just your smart TV thought it was more likely that the weather in your region would be warm on that day, so it adjusted the symbol and temperature accordingly"
jacobr1 4y ago
You could still use some kind of adaptive huffman coding. Current compression schemes have some kind of dictionary embedded in the file to map between the common strings and the compressed representation. Google tried proposing SDCH a few years using a common dictionary for wep pages. There isn't any reason why we can't be a bit more deterministic and share a much larger latent representation of "human visual comprehension" or whatever to do the same. It doesn't need to be stochastic once generated.
supergnu 4y ago
I mean, that is already happening. Almost all modern TV's do some signal processing before outputting the pixels, and the image looks slightly different on each model. But it'd definitely be cool to have some latent representation of a video that then gets rendered on tv - you could apply latent style sheets to the content, like what actors you want to play the roles, or turn everything into a steam-punk anime on the fly. The more abstract the representation, the more interesting alterations you could apply