I think you might be able to define the vector space "NoiseSpace" in which the random noise is generated as a subspace of the space of all images "ImageSpace",

I think you might be able to define the vector space "NoiseSpace" in which the random noise is generated as a subspace of the space of all images "ImageSpace", and generate an adverserial example using the quotient space ImageSpace / NoiseSpace.