4 ms·
I wonder if it will ever get to the point where we specifically as a lossy compression algorithm generate images that can be enhanced into what we want. “What i
by bee_rider 4y ago
I wonder if it will ever get to the point where we specifically as a lossy compression algorithm generate images that can be enhanced into what we want. “What is the smallest image that <popular AI of the day> will blow up into the image I want” might be an interesting question.
- madrox 4y agoFinally "enhance enhance enhance" won't just be a meme from CSI.
- nix0n 4y agoIt'll be used to convict the wrong person. Compression/decompression shouldn't be used for subtle details. We've seen problems with it before, with scanners[0]. [0]https://www.pcworld.com/article/453236/xerox-scanners-found-to-sometimes-alter-numbers.html https://www.pcworld.com/article/453236/xerox-scanners-found-...
- Gigachad 4y agoThese AI enhancers just make the image look like whatever the training set looked like. My favorite example of how flawed it is https://video-images.vice.com/test-uploads/articles/5ef216e9aea1330097d9ec64/lede/1592924226088-obama.jpeg?crop=1xw:0.7835555555555556xh;center,center https://video-images.vice.com/test-uploads/articles/5ef216e9... There is really no solution to this because even we couldn't tell this is wrong without prior knowledge of the left side.
- mcphage 4y agoThere was one issue I remember reading about where when someone upscale a picture, the upscale stick Ryan Reynold’s face in a building randomly.
- mawise 4y agoWhats the source of that image? It looks like a suspicious result, for example the white shirt is lost in the "upscaled" image. Was is trained on a specific set of images to prove this point?
- potatoman22 4y agoIt's from an algorithm called PULSE. It seems to search the latent space of StyleGAN to find a face that compresses to something similar to the query image. https://arxiv.org/pdf/2003.03808.pdf https://arxiv.org/pdf/2003.03808.pdf https://www.theverge.com/21298762/face-depixelizer-ai-machine-learning-tool-pulse-stylegan-obama-bias https://www.theverge.com/21298762/face-depixelizer-ai-machin...
- mawise 4y agoThanks for the link!
- roughly 4y agoI seem to recall a project someone did where they encoded an image's position in the latent space of a generative algorithm as the file and used the algorithm to recreate the image later, which wound up being a very efficient compression technique, albeit lossy in weirder ways than usual.
- deleted 4y ago[deleted]
- somat 4y agoAt one point the holy grail of compression algorithms was fractal encoding which if I understand correctly is basically asking the question what fractals do I need to get my image. theoretical compression ratios off the chart, the problem was the only method found to solve the problem was the "grad student algorithm", that is lock a grad student in a room with plenty of pizza and coffee until they figure out what fractals were needed. Perhaps these modern day generative programs(sigh, ok ok, "AI") is our generations solution to fractal encoding and the problem with scaling the graduate student algorithm. "Well we don't exactly know how to solve it but we took 60 Gb of linear algebra and hit it with a stick until it figured it out, no idea how it works but it appears to do the job"
- dreamcompiler 4y agoFractal compression worked automatically (grad student not required) but it typically took hours on the hardware of the late 80s/early 90s. And ISTR it worked well on particular images, but not generally. It's likely it would work much better on modern hardware, but it was heavily IP-encumbered back in the day which caused almost everybody working on image compression algorithms to ignore it. The patents have probably all expired by now so it might be worth another look.
- zimpenfish 4y ago> it was heavily IP-encumbered back in the day It was also horrifically expensive to license from what I remember which meant that almost no-one used it.
- gamegoblin 4y agoI've seen some prototype compression algorithms that work like: 1. Heavily compress image 2. Use neural net upscaler to upscale back to original size/quality 3. Record the diff between the real uncompressed image, and the upscaled image. This should be small if your neural net is good. 4. Store the compressed image + the diff. This is a lossless image compression algorithm. Part of the trick is that the neural net size is not included in the compressed file size, because that is amortized across many different files you'll be compressing/decompressing. It's not super portable, though, because whoever is opening your file needs identical neural net weights to get the identical output to apply the diff to. It wouldn't surprise me if eventually one of these neural nets gets baked into a standard somewhere, and every browser ships with that network baked in. Call it NeuralPNG or whatever.
- bee_rider 4y agoOh, that’s pretty clever
- jiggawatts 4y agoThat's a natural extension of prediction-based encodings, and I believe there are already some experimental ones for text. E.g.: predict the rest of the sentence using GPT-3 and then record the errors in its prediction.
- jug 4y agoI at least wish for an algorithm that handles this all too common banding issue. We already have formats supporting synthetic film grain (as in the format itself), so how about this? Banding can be taken care of by dithering — a very old technique.
- nhinck2 4y agoI thought Nvidia had done research into a video codec that works like this. It'd learn what a scene looked like and then switch to send a really low quality stream to the other person to reconstruct or something like that.