4 ms·

M1 runs SD in a few seconds. Is 2080ti faster than that?

terafo 4y ago
It is hard to tell since you don't provide exact numbers. I've seen SD generating 50 samples 512x512 image on 2080 Ti in 8 seconds, but it is almost certain that there is a faster version out there.
- jeffbee 4y ago
  A 2080 Ti, which requires a supporting platform, seems like a really bad deal compared to a 16GB M1, which you can get factory refurbished for $1000.
  - lostmsu 4y ago
    Stable Diffusion is but 1 project. M1 gonna be a huge bottleneck for anything that takes time. That "Ultra" for $4k is about 5 times slower than a single 3090. It will be nearly 10 times slower than 4090.
  - wongarsu 4y ago
    A used 2080TI goes for around $500, with the remaining $500 I can get a computer with a 6x3.6GHz Ryzen 5 and 16GB RAM. Which is something completely different than a Macbook Air, so that's kind of an apples to oranges comparison, but I don't see the big price advantage. And presumably GP already has the "supporting platform", since they are upgrading, making the 2080TI upgrade half the price of a switch to an m1?
  - terafo 4y ago
    It is VASTLY slower than 2080Ti. There is no competition at all. I don't know exact performance numbers, but I would estimate that M1 takes more than a minute to generate one image. UPD: asked a friend to generate image on m1 with diffusion bee. It took 4 minutes 30 seconds to generate one 25 sample image. It is not even close and much worse than I thought.
    - jeffbee 4y ago
      Must have been an 8GB model. On my 16GB it takes a few seconds.
      - capableweb 4y ago
        Could you provide the exact settings you use for generating the image? Settings matter a lot in terms of it/s. Also please share the exact it/s you're getting :)
      - terafo 4y ago
        It was on 16GB model. Can you provide details how do you run them and how fast it can run.
- wongarsu 4y ago
  I just tried it, on my 2080ti I get a 50 sample 512x512 image in 7.0 to 7.5 seconds (using PLMS, DDIM or k_lms). Or at 256x256 with 8-image batches about 1.15 seconds per image.
cageface 4y ago
I've seen 30-60 seconds for M1 / M1 Pro. Is that what you mean by a few seconds?

It is hard to tell since you don't provide exact numbers. I've seen SD generating 50 samples 512x512 image on 2080 Ti in 8 seconds, but it is almost certain that there is a faster version out there.

jeffbee 4y ago
A 2080 Ti, which requires a supporting platform, seems like a really bad deal compared to a 16GB M1, which you can get factory refurbished for $1000.
- lostmsu 4y ago
  Stable Diffusion is but 1 project. M1 gonna be a huge bottleneck for anything that takes time. That "Ultra" for $4k is about 5 times slower than a single 3090. It will be nearly 10 times slower than 4090.
- wongarsu 4y ago
  A used 2080TI goes for around $500, with the remaining $500 I can get a computer with a 6x3.6GHz Ryzen 5 and 16GB RAM. Which is something completely different than a Macbook Air, so that's kind of an apples to oranges comparison, but I don't see the big price advantage. And presumably GP already has the "supporting platform", since they are upgrading, making the 2080TI upgrade half the price of a switch to an m1?
- terafo 4y ago
  It is VASTLY slower than 2080Ti. There is no competition at all. I don't know exact performance numbers, but I would estimate that M1 takes more than a minute to generate one image. UPD: asked a friend to generate image on m1 with diffusion bee. It took 4 minutes 30 seconds to generate one 25 sample image. It is not even close and much worse than I thought.
  - jeffbee 4y ago
    Must have been an 8GB model. On my 16GB it takes a few seconds.
    - capableweb 4y ago
      Could you provide the exact settings you use for generating the image? Settings matter a lot in terms of it/s. Also please share the exact it/s you're getting :)
    - terafo 4y ago
      It was on 16GB model. Can you provide details how do you run them and how fast it can run.
wongarsu 4y ago
I just tried it, on my 2080ti I get a 50 sample 512x512 image in 7.0 to 7.5 seconds (using PLMS, DDIM or k_lms). Or at 256x256 with 8-image batches about 1.15 seconds per image.

cageface 4y ago

I've seen 30-60 seconds for M1 / M1 Pro. Is that what you mean by a few seconds?