4 ms·
I'm wondering why the image comes out non-blocky because transformers would take slices of the image as input. They say they have about 1024 tokens for the imag
by visarga 6y ago
I'm wondering why the image comes out non-blocky because transformers would take slices of the image as input. They say they have about 1024 tokens for the image and that would mean 32x32 patches. How is it possible that these patches align along the edges so well and not have JPEG like artifacts?
- minimaxir 6y agoIf you read footnote #2, the source images are 256x256 but downsampled using a VAE, and presumably upsampled using a VAE for publishing (IIRC they are less prone to the infamous GAN artifacts).
- visarga 6y agoI know they use VQ-VAE under the transformer, but that would generate one symbol per 8x8 box. When you tile them up they should have some mosaic artifacts along the edges, if they generate these patches independently.