3 ms·
I thought it was that VAEs generate blurry images. Has anyone been able to make VAEs as good as GANs for image generation?
by visarga 9y ago
I thought it was that VAEs generate blurry images. Has anyone been able to make VAEs as good as GANs for image generation?
- twanvl 9y agoIIRC there was a NIPS 2016 paper that showed that the blurry images are because of the variational approximation used in the generator/decoder network. They replaced this by doing MCMC inference on the encoder network, and showed that you get sharper images, but much less efficiently. In general, variational inference will always tend to model the mean or mode of the data.
- trextrex 9y agoThere was one theoretical paper to enable learning more complex distributions in the encoding layer(s) while still using a factorized gaussian or similarly simple distribution to derive the learning rules [1]. This approach should, in theory, lead to generation of sharper images, although that particular paper doesn't show examples of it. [1] https://arxiv.org/abs/1505.05770 https://arxiv.org/abs/1505.05770