Actually i need to correct myself. Something along these lines. The mechanism of DALL-E is a bit different but a discriminator approach should work anyway altho

Actually i need to correct myself. Something along these lines. The mechanism of DALL-E is a bit different but a discriminator approach should work anyway although maybe some magic might be needed to ensure the spatial invariance of the discriminator.