4 ms·
M2 will be a joke for the AI models of the future. The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run
by anonylizard 3y ago
M2 will be a joke for the AI models of the future.
The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run (Aka more than 100GB VRAM). That's why their quality is leaps and bounds above stable diffusion XL, its because the model size simply allows for it.
Model sizes continuously grow to exploit the available hardware to the limit. Midjourney and GPT-4 have both proven that model quality is decisive to success and paying customers, so consumer hardware can never catchup to whatever Nvidia sells to the cloud.
- l33t7332273 3y agoHow much vram does an a100 have? The M2 ultra has more than 100 GB.
- Auracle 3y agoI don’t think I’d say Midjourney is “leaps and bounds” above SDXL. It’s better overall, but SDXL closed the gap a significant amount.
- polygamous_bat 3y ago> The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run Do you have any source for this speculation? In my experience image models are always much smaller than language and even the largest llama will fit in a smaller GPU machine than that.
- GaggiX 3y ago>The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run (Aka more than 100GB VRAM) Unet are really expensive to run compare to a regular GPT model and they are compute-bound thx to convolution, a reason why no one has trained a unet that comes close to consume 100GB of VRAM during inference. I doubt that MJ is much bigger than SD XL, it's good but not revolutionary.
- saberience 3y agoHave you tried actually downloading SD and all the various custom models and tools? For me it kicks the shit out of Midjourney in flexibility and quality. I can make more images of higher quality, faster and cheaper.
- gmerc 3y agoMidjourney trades flexibility for consistent quality and consumer accessibility. An optimized XL model in the hands of an expert beats it, handily. And Adobe sells to experts, not consumers for the most part.
- baz00 3y agoI suspect that the energy cost will be the limiting factor here. Which will constrain models eventually.