3 ms·

Is the mac studio with the Apple M2 Max with 12‑core CPU, 30‑core GPU enough for something like this?

minimaxir 3y ago
Likely not. Even with earlier models performance may be finnicky: https://huggingface.co/docs/diffusers/optimization/mps https://huggingface.co/docs/diffusers/optimization/mps Additionally, for Apple Silicon you likely need 64 GB RAM (since CPU/GPU memory is shared) which is expensive.
- pkage 3y ago
  I’ve had good results with SD1.4/2 with MPS acceleration on similar hardware (M1 Max, though with 64gb). No stability issues with MPS, either. I’d say don’t rule it out just yet.
- SkyPuncher 3y ago
  I have an M2 MBP with 64 GB RAM. Performance with the older models is very good in my opinion. It feels to run faster locally than DreamStudio. I don't have benchmarks, but in any case the performance is not bad.
itake 3y ago
My guess is you will need cuda support until someone ports it to mips
jrflowers 3y ago
System requirements Despite its powerful output and advanced model architecture, SDXL 0.9 is able to be run on a modern consumer GPU, needing only a Windows 10 or 11, or Linux operating system, with 16GB RAM, an Nvidia GeForce RTX 20 graphics card (equivalent or higher standard) equipped with a minimum of 8GB of VRAM. Linux users are also able to use a compatible AMD card with 16GB VRAM. I’m guessing that it will work eventually, though I’m not sure who will make that happen.
brucethemoose2 3y ago
Apple ported Stable Diffusion 1.5/2.1 to MPS themselves. If they don't so it for SDXL, the port will probably take awhile (if it happens at all).
- nozzlegear 3y ago
  I've used Apple's port of Stable Diffusion on my Mac Studio with M1 Ultra and it worked flawlessly. I could even download models from Hugging Face and convert them to a CoreML model with little effort using Apple's conversion tool documented in their Stable Diffusion repo [1]. Some models on Hugging Face are already converted – I think anything tagged with CoreML. [1] https://github.com/apple/ml-stable-diffusion https://github.com/apple/ml-stable-diffusion

Likely not. Even with earlier models performance may be finnicky: https://huggingface.co/docs/diffusers/optimization/mps https://huggingface.co/docs/diffusers/optimization/mps Additionally, for Apple Silicon you likely need 64 GB RAM (since CPU/GPU memory is shared) which is expensive.

pkage 3y ago
I’ve had good results with SD1.4/2 with MPS acceleration on similar hardware (M1 Max, though with 64gb). No stability issues with MPS, either. I’d say don’t rule it out just yet.
SkyPuncher 3y ago
I have an M2 MBP with 64 GB RAM. Performance with the older models is very good in my opinion. It feels to run faster locally than DreamStudio. I don't have benchmarks, but in any case the performance is not bad.

itake 3y ago

My guess is you will need cuda support until someone ports it to mips

jrflowers 3y ago

System requirements Despite its powerful output and advanced model architecture, SDXL 0.9 is able to be run on a modern consumer GPU, needing only a Windows 10 or 11, or Linux operating system, with 16GB RAM, an Nvidia GeForce RTX 20 graphics card (equivalent or higher standard) equipped with a minimum of 8GB of VRAM. Linux users are also able to use a compatible AMD card with 16GB VRAM. I’m guessing that it will work eventually, though I’m not sure who will make that happen.

brucethemoose2 3y ago

Apple ported Stable Diffusion 1.5/2.1 to MPS themselves. If they don't so it for SDXL, the port will probably take awhile (if it happens at all).

nozzlegear 3y ago
I've used Apple's port of Stable Diffusion on my Mac Studio with M1 Ultra and it worked flawlessly. I could even download models from Hugging Face and convert them to a CoreML model with little effort using Apple's conversion tool documented in their Stable Diffusion repo [1]. Some models on Hugging Face are already converted – I think anything tagged with CoreML. [1] https://github.com/apple/ml-stable-diffusion https://github.com/apple/ml-stable-diffusion