2 ms·

I was really hoping this was a "diffusion model" in the same sense that these guys built a reaction-diffusion based self-healing system: https://distill.pub/20

• jawarner 4y ago
  The reaction diffusion / NCA models have been applied to videos recently — check it out: https://wandb.ai/johnowhitaker/nca/reports/Fun-with-Neural-Cellular-Automata--VmlldzoyMDQ5Mjg0 https://wandb.ai/johnowhitaker/nca/reports/Fun-with-Neural-C...
• jiggawatts 4y ago
  That was a fascinating article with a great mix of readability and interactive demos.
• sampo 4y ago
  Yeah, the neural network "diffusion models" are not very well named. If you have background in natural sciences, you would understand diffusion to mean, well, diffusion. Whereas there generative neural networks are about (1) blurring data by Gaussian noise, (2) teaching a NN to denoise the noised data, and finally (3) with Gaussian noise as input, let the denoiser NN to generate new data. So it's not so much about diffusion as it's about reversing the diffusion. And it's not really (smooth) diffusion, but Gaussian noise. "Denoising autoencoder" is already used for processes that reconstruct partially corrupted input. So what name to suggest for a process that reconstructs data from nothing but noise?