3 ms·
It is 50x times slower on M1 than on RTX 3090. M1 takes ~4.2s per iteration, 3.5 minutes per image [0]. RTX 3090 takes ~4.7s per image (all 50 iterations) [1]
by coolspot 4y ago
It is 50x times slower on M1 than on RTX 3090.
M1 takes ~4.2s per iteration, 3.5 minutes per image [0].
RTX 3090 takes ~4.7s per image (all 50 iterations) [1].
[0] - https://wandb.ai/morgan/stable-diffusion/reports/Running-Stable-Diffusion-on-an-Apple-M1-Mac-with-Hugging-Face-Diffusers--VmlldzoyNTU2ODc2 https://wandb.ai/morgan/stable-diffusion/reports/Running-Sta...
[1] - trust me bro
- shrimpx 4y agoBtw that's the kind of perf I see on my M1, but I keep seeing "0.00G VRAM used" for each generation. I wonder what that's about. In Activity Monitor I do see the GPU being used.
- coolspot 4y agoSD measures VRAM usage by calling a specific pyTorch method which usually wraps CUDA call. I guess whomever ported that to M1 just haven’t implemented that method.
- davidy123 4y agoOK, I must have misread some comments. Thanks for the update.