3 ms·
This is a paper submission that was submitted to the ICLR 2019 conference. To preserve the integrity of the double-blind submission process please do not "dox"
by ericjang 8y ago
This is a paper submission that was submitted to the ICLR 2019 conference. To preserve the integrity of the double-blind submission process please do not "dox" the identities of the authors. I am not an author of this paper.
Previous works in this area (and there are many) have tackled the exact problem of natural image generation. The specifics of the methods presented in the paper are of considerable interest to the ML/AI research community, but what I'd like to highlight here the results.
One might suppose that a neural network could never make images consistent with reality because there are so many hidden latent variables & strong causal factors that lead to the generation of coherent real-world imgaes. For instance, laws of light transport and camera perspective, smooth texture variation on objects, bilateral symmetry in organisms, what objects are "possible" and which objects are not.
Often to generate images that are at least plausible under our reality we need to make use of explicit physically-based rendering techniques like simulating the transport of light and accurately modeling a lot of high-fidelity geometry. We have to hard-code so many physical equations and rules into these systems, and even then we still have a hard time rendering everyday things (candlelight, soap bubbles, food).
Prior to this paper, I certainly had my doubts that neural networks could ever capture enough implicit "knowledge" about the world to synthesize an image (not in the training set, mind you) that could convince a human it was real. Machine Learning is the study of generalization and we know of no useful guarantees on generalization for finite-size training sets and overparameterized models.
To my knowledge, this is the first paper to generate high-fidelity natural images with no apparent visual artifacts (blurriness, weird textures that could not exist in the real world). The laws of light transport (NP-hard to compute) appear to be convincingly preserved, and I am blown away.