3 ms·
tl;dr, a faster alternative to diffusion models for image and A/V generation. Abstract of the paper: > Diffusion models have made significant breakthroughs in
by rattray 4y ago
tl;dr, a faster alternative to diffusion models for image and A/V generation.
Abstract of the paper:
> Diffusion models have made significant breakthroughs in image, audio, and video generation, but they depend on an iterative generation process that causes slow sampling speed and caps their potential for real-time applications. To overcome this limitation, we propose consistency models, a new family of generative models that achieve high sample quality without adversarial training. They support fast one-step generation by design, while still allowing for few-step sampling to trade compute for sample quality. They also support zero-shot data editing, like image inpainting, colorization, and super-resolution, without requiring explicit training on these tasks. Consistency models can be trained either as a way to distill pre-trained diffusion models, or as standalone generative models. Through extensive experiments, we demonstrate that they outperform existing distillation techniques for diffusion models in one- and few-step generation. For example, we achieve the new state-of-the-art FID of 3.55 on CIFAR-10 and 6.20 on ImageNet 64x64 for one-step generation. When trained as standalone generative models, consistency models also outperform single-step, non-adversarial generative models on standard benchmarks like CIFAR-10, ImageNet 64x64 and LSUN 256x256.
https://arxiv.org/abs/2303.01469 https://arxiv.org/abs/2303.01469
- nr2x 4y agoAm I correct the upshot is the Stable Diffusion community is going to take this and make more weird shit? Because that is a good thing, especially since Ope AI has pretty much neglected Dall-E since launch.
- Der_Einzige 4y agoThey also neglected Point-E, for 3D object creation.
- rattray 4y agoTIL: https://openai.com/research/point-e https://openai.com/research/point-e Came out back in Dec '22
- goosinmouse 4y agoTo be fair, i never was able to create any 3D object with Point-E that was anything more than one step above a blob. Considering the reaction ChatGPT i don't blame them for reallocating resources if that's what happened.
- deleted 4y ago[deleted]