2 ms·
Faces aren’t perfectly symmetrical though, while mirror reflections are physics. The degree to which the landscape reflection symmetries are off in the article
by dahart 4y ago
Faces aren’t perfectly symmetrical though, while mirror reflections are physics. The degree to which the landscape reflection symmetries are off in the article might be acceptable when generating faces.
One possible reason the same approach might not work in both cases could be that DALLE’s training set has more faces than landscapes with still water lakes, it’d have to learn these two symmetry constraints through enough clear examples in both cases, and no counter-examples. I can imagine counter-examples for both faces and landscapes that could potentially inhibit learning symmetry, like faces from an angle or side view, or landscapes with an occluder, but I have no idea how often these occur in DALLE’s training set. Getting this right means that DALLE somehow needs to learn the concept and the symmetry constraint from all the imagery, it has to understand the world a little, not just have pixels to borrow. It’s a hard problem, and at some level surprising how well it’s doing with the landscapes.