With tens of thousands of training images, and hundreds of dimensions in the latent space, I don't think I would assume this is true. You may be thinking one fe

With tens of thousands of training images, and hundreds of dimensions in the latent space, I don't think I would assume this is true. You may be thinking one feature is "eyes", but the eyes may instead be built out of 10 sub-features. Those sub-features may be inextricably linked to other, identifiable, macro-features.