5 ms·
The most popular method using autoregression in image generation space is to predict image patches/tokens and not pixels, though that still scales worse than di
by famouswaffles 2y ago
The most popular method using autoregression in image generation space is to predict image patches/tokens and not pixels, though that still scales worse than diffusion.
A fairly new but promising approach for autoregression that seems to scale as well as diffusion is predicting the next image scale/resolution rather than the next image patch.
https://arxiv.org/abs/2404.02905 https://arxiv.org/abs/2404.02905