Diffusion also. It produces startlingly dream-like imagery, especially the videos. Things like that to me are a solid evidence that we "nailed it" with reprodu

Diffusion also. It produces startlingly dream-like imagery, especially the videos. Things like that to me are a solid evidence that we "nailed it" with reproducing the neural activity of a living being. Of course, architectures will come and go, but they just nudge the shape of the network in a given direction, they don't define it, as most of the network is trained, evolved. It has hidden architecture no human has designed, and the patterns in that hidden architecture resemble our own thought patterns.