4 ms·

I’m waiting for someone to wrap this up into a desktop app that I can install and run on my Mac.

by offsky 4y ago

geuis 4y ago
I've been looking into this for the last 2 days. Unless you're running an M1 Mac or newer, you're SOL. Stable Diffusion is built on PyTorch. PyTorch mainly has been designed to work with Nvidia cards. However PyTorch added support for something called RocM like a year ago that adds compatibility with newer AMD cards. Unfortunately RocM doesn't support slightly older AMD cards in conjunction with intel processors. So my 32gb pretty powerful 2020 16in MacBook Pro isn't capable of running Stable Diffusion. Any native app will likely have to rely on a remote cloud gpu. And boy, those are fucking expensive. Been researching what I need to stand up a service the last few days and it isn't cost friendly.
- minimaxir 4y ago
  There is work on a CoreML version which may play nicer with older Macs w/sufficiently beefy dGPUs. https://github.com/huggingface/diffusers/issues/443 https://github.com/huggingface/diffusers/issues/443
  - osener 4y ago
    Will the CoreML version run faster than https://replicate.com/blog/run-stable-diffusion-on-m1-mac https://replicate.com/blog/run-stable-diffusion-on-m1-mac on an M1 Mac?
- fragmede 4y ago
  Apple's MPS drivers supports AMD GPUs on MacOS
  - geuis 4y ago
    Just heard about MPS in another thread.
- danuker 4y ago
  > And boy, those are fucking expensive. Unless you want to train the model, Lambda Labs is somewhat cheap: https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud
- dreamcompiler 4y ago
  I've been running the Intel CPU version [0] for a while now on a 2013 MacMini. Works fine; it takes several minutes per image but I can live with that. [0] https://news.ycombinator.com/item?id=32642255 https://news.ycombinator.com/item?id=32642255
- kcartlidge 4y ago
  > I've been looking into this for the last 2 days. Unless you're running an M1 Mac or newer, you're SOL. And not just any old M1 Mac. Last week I got it running on my 2021 8GB M1 MacBook Air and it's slow. Images at 512x512 with 10 steps take between 7 and 10 minutes to generate. It's the only thing I do that hits performance limitations on the 8GB machine so there's no regrets on that score, but with the way this stuff is progressing 16GB+ is a realistic minimum for comfortable use.
  - moozilla 4y ago
    FWIW I'm on a 2021 16GB M1 MacBook Pro and it takes about 7min for me as well. I've just been following the steps here with default settings: https://replicate.com/blog/run-stable-diffusion-on-m1-mac https://replicate.com/blog/run-stable-diffusion-on-m1-mac, but maybe there's a better way to run it at this point?
    - kcartlidge 4y ago
      That's what I initially followed, too. But there does seem to be a better way - I've just installed CHARL-E [0] (mentioned elsewhere in this thread) and it was trivial to set up. Literally download the dmg, drag into Applications, and run. It's an electron app and you can either download it with the weights, or without and add them separately. Using that it just took slightly over 5 minutes on my 8GB so it's a little bit quicker for me. Maybe the code has improved since I cloned stuff over a week ago, or maybe it's just different system resources when it is run. Either way, it looks like the easy way I've been waiting for. [0] https://www.charl-e.com https://www.charl-e.com Edit: It is however missing the CFG setting.
westoncb 4y ago
I’ve been working on a queue-centric desktop app GUI for SD: https://twitter.com/westoncb/status/1568114946235580418?s=46&t=oVdjv8q2XRz7qpM6bA3rsA https://twitter.com/westoncb/status/1568114946235580418?s=46... I plan to wrap things up and put out the source this weekend.
fragmede 4y ago
https://www.charl-e.com/ https://www.charl-e.com/ There are a few bugs to iron out before it's ready for prime time. For now, create the folder `~/Desktop/charl-e/samples/` manually before you run it.
- tasuki 4y ago
  Funny, it probably does a whole lotta things, but it can't create the `~/Desktop/charl-e/samples/` directory? That seems like it should be relatively trivial...
- kcartlidge 4y ago
  Great stuff, and works on an 8GB M1 Air taking between 5 and 10 minutes for between 5 and 15 steps. As a suggestion, perhaps add the option for setting the CFG too (I know, it's open source etc, but it's just a suggestion).
kierangill 4y ago
Same! I wrote a public web app so that I could access the model from my phone [0]. This is how I found Replicate [1]. Their SD model is very cheap to use. While we wait for a native Mac app, I recommend accessing the model straight from their web UI. [0] https://www.drawanything.app/ https://www.drawanything.app/ [1] https://replicate.com/ https://replicate.com/

I’m waiting for someone to wrap this up into a desktop app that I can install and run on my Mac.

by offsky 4y ago

I’m waiting for someone to wrap this up into a desktop app that I can install and run on my Mac.

I've been looking into this for the last 2 days. Unless you're running an M1 Mac or newer, you're SOL. Stable Diffusion is built on PyTorch. PyTorch mainly has been designed to work with Nvidia cards. However PyTorch added support for something called RocM like a year ago that adds compatibility with newer AMD cards. Unfortunately RocM doesn't support slightly older AMD cards in conjunction with intel processors. So my 32gb pretty powerful 2020 16in MacBook Pro isn't capable of running Stable Diffusion. Any native app will likely have to rely on a remote cloud gpu. And boy, those are fucking expensive. Been researching what I need to stand up a service the last few days and it isn't cost friendly.

minimaxir 4y ago
There is work on a CoreML version which may play nicer with older Macs w/sufficiently beefy dGPUs. https://github.com/huggingface/diffusers/issues/443 https://github.com/huggingface/diffusers/issues/443
- osener 4y ago
  Will the CoreML version run faster than https://replicate.com/blog/run-stable-diffusion-on-m1-mac https://replicate.com/blog/run-stable-diffusion-on-m1-mac on an M1 Mac?
fragmede 4y ago
Apple's MPS drivers supports AMD GPUs on MacOS
- geuis 4y ago
  Just heard about MPS in another thread.
danuker 4y ago
> And boy, those are fucking expensive. Unless you want to train the model, Lambda Labs is somewhat cheap: https://lambdalabs.com/service/gpu-cloud https://lambdalabs.com/service/gpu-cloud
dreamcompiler 4y ago
I've been running the Intel CPU version [0] for a while now on a 2013 MacMini. Works fine; it takes several minutes per image but I can live with that. [0] https://news.ycombinator.com/item?id=32642255 https://news.ycombinator.com/item?id=32642255
kcartlidge 4y ago
> I've been looking into this for the last 2 days. Unless you're running an M1 Mac or newer, you're SOL. And not just any old M1 Mac. Last week I got it running on my 2021 8GB M1 MacBook Air and it's slow. Images at 512x512 with 10 steps take between 7 and 10 minutes to generate. It's the only thing I do that hits performance limitations on the 8GB machine so there's no regrets on that score, but with the way this stuff is progressing 16GB+ is a realistic minimum for comfortable use.
- moozilla 4y ago
  FWIW I'm on a 2021 16GB M1 MacBook Pro and it takes about 7min for me as well. I've just been following the steps here with default settings: https://replicate.com/blog/run-stable-diffusion-on-m1-mac https://replicate.com/blog/run-stable-diffusion-on-m1-mac, but maybe there's a better way to run it at this point?
  - kcartlidge 4y ago
    That's what I initially followed, too. But there does seem to be a better way - I've just installed CHARL-E [0] (mentioned elsewhere in this thread) and it was trivial to set up. Literally download the dmg, drag into Applications, and run. It's an electron app and you can either download it with the weights, or without and add them separately. Using that it just took slightly over 5 minutes on my 8GB so it's a little bit quicker for me. Maybe the code has improved since I cloned stuff over a week ago, or maybe it's just different system resources when it is run. Either way, it looks like the easy way I've been waiting for. [0] https://www.charl-e.com https://www.charl-e.com Edit: It is however missing the CFG setting.

westoncb 4y ago

I’ve been working on a queue-centric desktop app GUI for SD: https://twitter.com/westoncb/status/1568114946235580418?s=46&t=oVdjv8q2XRz7qpM6bA3rsA https://twitter.com/westoncb/status/1568114946235580418?s=46... I plan to wrap things up and put out the source this weekend.

fragmede 4y ago

https://www.charl-e.com/ https://www.charl-e.com/ There are a few bugs to iron out before it's ready for prime time. For now, create the folder `~/Desktop/charl-e/samples/` manually before you run it.

tasuki 4y ago
Funny, it probably does a whole lotta things, but it can't create the `~/Desktop/charl-e/samples/` directory? That seems like it should be relatively trivial...
kcartlidge 4y ago
Great stuff, and works on an 8GB M1 Air taking between 5 and 10 minutes for between 5 and 15 steps. As a suggestion, perhaps add the option for setting the CFG too (I know, it's open source etc, but it's just a suggestion).

kierangill 4y ago

Same! I wrote a public web app so that I could access the model from my phone [0]. This is how I found Replicate [1]. Their SD model is very cheap to use. While we wait for a native Mac app, I recommend accessing the model straight from their web UI. [0] https://www.drawanything.app/ https://www.drawanything.app/ [1] https://replicate.com/ https://replicate.com/