4 ms·
The trick is to start with random "gaussian noise" - something like https://opendatascience.com/wp-content/uploads/2017/03/noise3-560x300.jpg https://opendatasc
by simonw 5y ago
The trick is to start with random "gaussian noise" - something like https://opendatascience.com/wp-content/uploads/2017/03/noise3-560x300.jpg https://opendatascience.com/wp-content/uploads/2017/03/noise... - and then iteratively modify that image until it starts to look like the concept you want it to look like.
I find the concept of a GAN - a Generative Adversarial Network - useful.
My high-level attempt at explaining how those work is that you create two machine learning models, one that tries to create fake images and one that tries to see if an image is fake or not.
The first one says "here's an image", the second one says "that's a fake", the first one learns from that and tries again, then keep going until an image scores highly on the test.
The networks are adversarial because they are trying to outwit each other.
(I'm sure a ML researcher could provide a better explanation than I can, but that's the way I think about it.)
- goodside 5y agoI don't believe Dall-E 2 incorporates GANs at all, but I haven't read the paper in detail. GANs were the best text-to-image models maybe a year ago but lately diffusion techniques are taking over.
- simonw 5y agoThanks for the keyword hint - this explanation looks good for diffusion models: https://ai.googleblog.com/2021/07/high-fidelity-image-generation-using.html https://ai.googleblog.com/2021/07/high-fidelity-image-genera...
- hackernewds 5y agothat is a very interesting and clear explanation, assuming it is correct (it is not my field but I would love to know if it isn't!)