4 ms·
This might be a good opportunity to lead to research on a "good faith watermark" for GAN-compressed images that may include hallucinated details.
by mmastrac 6y ago
This might be a good opportunity to lead to research on a "good faith watermark" for GAN-compressed images that may include hallucinated details.
- gtoderici 6y agoOne of the things we discussed to address this is to have the ability to: a) turn off detail hallucination completely given the same bitstream; and b) store the median/maximum absolute error across the image (b) should allow the user to determine whether the image is suitable for their use-case.
- AbrahamParangi 6y agoYou could use an OCR encoder and cat that to the feature vector. Great work by the way!
- atorodius 6y agoAgreed! Alternatively, some semantic segmentation network could be used and a masked MSE loss. In this paper, we focussed on showing the crazy potential of GANs for compression - let's see what future work brings.
- the8472 6y agoIs it possible to put the decoder into a feedback loop and search among multiple possible encodings that minimize the residual errors? Similar to trellis optimization in video codecs. http://akuvian.org/src/x264/trellis.txt http://akuvian.org/src/x264/trellis.txt
- atorodius 6y agoIt would be possible - but by minimizing residual errors you end up in a similar regime as when minimizing MSE again, likely making reconstructions blurry!