14 ms·

Diffusion Bee: Stable Diffusion GUI App for M1 Mac

727 points by divamgupta 4y ago

divamgupta 4y ago
Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed. Features: - Full data privacy - nothing is sent to the cloud - Clean and easy to use UI - One click installer - No dependencies needed - Multiple image sizes - Optimized for M1/M2 Chips - Runs locally on your computer
- scsilver 4y ago
  Thank you for this. How hard would this be to port to ipad?
  - ShamelessC 4y ago
    Probably isn’t fast enough.
    - wlesieutre 4y ago
      The Pro and Air models have M1 chips, roughly on par with a MacBook Air
      - ShamelessC 4y ago
        Oh wow! Didn’t realize.
        firecall 4y ago
        RAM might hold it back? Still, probably not too hard to build for iPad or iOS.
        Gigachad 4y ago
        The ipad pro has a 16gb option. It's essentially the same hardware as the macbook.
        wlesieutre 4y ago
        iPad Pro got it in spring 2021, so an M2 refresh seems likely too. October event along with an M2 MacBook Pro refresh? Or maybe not until spring 2023. Another comment mentions RAM capabilities. Unfortunately that’s tied to the storage tiers instead of being something you can pick separately, so if you want 16 GB of RAM you have to buy the 1 TB or 2 TB models. Meaning for a 12.9” iPad Pro, if you want 16 GB you’re looking at an $1800 tablet. Not ideal.
- jwuphysics 4y ago
  Thanks for sharing. Can you say a little bit more about what prompted you to make this?
  - divamgupta 4y ago
    Well, all the other offline tools seem didn't seem very intuitive to install, for someone without technical knowledge.
    - youssefabdelm 4y ago
      Even for someone with technical knowledge this is a breath of fresh air...why go through the trouble of even writing a script? I just wanna click a button and see something
- keyle 4y ago
  If it works, it's incredible!
  - thrill 4y ago
    It works, well, incredibly.
    - fibonacc 4y ago
      how is this possible without a dedicated gPU? thought stable diffusion would require far more horsepower
      - happyopossum 4y ago
        M1s, especially the Max and Ultra, have pretty decent GPUs.
      - indigodaddy 4y ago
        They have integrated GPU that I believe Apple claimed was comparable to RTX 3090 (perhaps since debunked though or at the least maybe a misleading claim).
        10u152 4y ago
        I believe thats cherry picked data. More specifically apple says it’s comparable to the 3090x at a given power budget of 100 watts. They don’t mention that the 3090 goes up to 360 watts.
        joakleaf 4y ago
        Apple compared M1 max to RTX 3080 (mobile) which was a stretch. M1 ultra was compared to RTX 3090 which was a larger stretch. The M1 max deliver about 10.5 tflops The M1 ultra about 21 tflops. The desktop RTX 3080 delivers about 30 tflops and RTX 3090 about 40. Apple’s comparison graph showed the speed of the M1s vs. RTXs at increasing power levels, with the M1s being more efficient at the same watt levels (which is probably true). However, since the graph stopped before the RTX GPUs reached full potential, the graph was somewhat misleading. The M1 max and Ultra have extra video processing modules that make them faster than the RTX GPUs at some video tasks though.
- metadat 4y ago
  Does it work with pornographic or potentially pornographic prompts?
  - simondotau 4y ago
    And the real questions come out. Seriously though, I imagine this is less a case of whether this specific implementation permits pornography, but whether any porn was included in the dataset it was trained on. No matter how good AI is, it only knows what it knows.
    - metadat 4y ago
      Based on the upvotes, inquiring minds _really want to know_!
      - indigodaddy 4y ago
        How do you see upvotes? I’ve never had any visibility to upvoted comments (downvoted of course yes), or at least it’s not obvious at all to me and see no indication of it..
        gpm 4y ago
        You can see the total score (upvotes - downovtes) for your comment where you see the upvote/downvote button for everyone else's comments. Or at least I can.
      - Tagbert 4y ago
        I’ve always been curious about that, too. I don’t think I see anyone else’s votes, up or down.
      - josephg 4y ago
        It can make porn images, but I haven't been able to get consistently good results. There's probably ways to tweak the parameters to improve things, but I haven't figured that out. It mostly understands what naked people look like, but the images I've generated involve a lot of accidental body horror. You get a lot of people with extra arms, weird eyes, or body parts in the wrong places. The fact that they explicitly removed porn from the training set comes through pretty clearly in the model. I suspect it could be improved a lot with some specialized retraining. As far as I know, nobody has done that work yet.
- swyx 4y ago
  do you mind putting a license on your repo? as it is right now Diffusion Bee is technically not open source.
keizo 4y ago
amazing, look forward to trying it out. has anyone done the same for windows?
- fragmede 4y ago
  Yes: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui No idea if it supports AMD GPUs though.
  - KaoruAoiShiho 4y ago
    Do you have any info on perf compared to this: https://news.ycombinator.com/item?id=32805174 https://news.ycombinator.com/item?id=32805174
    - fragmede 4y ago
      More optimization work has and is going into Nvidia support, so those are currently faster. Pytorch support for MPS devices is relatively new, so there's a ton of optimization that hasn't been done yet, so it's not clear which underlying hardware is actually faster for this specific task, but it looks like the top end Apple Silicon is in the same bracket as a consumer-grade Nvidia GPU.
      - dannyw 4y ago
        My consumer 3060 does 7.2 it/s, which is 5x faster than the M2. Sorry, Apple is nowhere close yet.
    - zimpenfish 4y ago
      Just done a run on my 3080 under Windows using https://github.com/bfirsh/stable-diffusion.git https://github.com/bfirsh/stable-diffusion.git and it's about 8 iterations/sec when nothing else is using CPU or GPU.
  - nuclearsugar 4y ago
    Thanks for this, exactly what I was looking for
andrei_says_ 4y ago
Has anyone looked at the code and verified the statements in the readme?
- ShamelessC 4y ago
  Why not just do this yourself before commenting?
  - ralusek 4y ago
    Because this is a community, and I appreciate having had the question asked and answered, as do many others I'm sure.
- float4 4y ago
  Ran it with Little Snitch installed (why bother looking at the code when a malicious actor can just upload a modified binary anyway?) and the claims seem to be legit so far.
  - ralusek 4y ago
    Presumably need to look at code, build code, and compare binaries.
toomuchtodo 4y ago
Thank you for this public service OP! Might consider adding “Show HN” to the prefix if you’ve got the characters left.
ryatkins 4y ago
Can you support MacOS Monterey 12.4? You're only supporting Ventura 12.5+ and it isn't even released yet.
- donut2d 4y ago
  12.5.1 is the latest, non-beta release. That's still Monterey. Ventura will be 13.x.
indigodaddy 4y ago
How long is the generation taking on say a 2021 MacBook M1 Pro?
- deleted 4y ago
  [deleted]
- andreasley 4y ago
  55 seconds on a M1 Pro MacBook with 16GB RAM to generate a picture (with default settings, so 512x512, 25 steps). On a M1 Ultra, it takes 12 seconds with 64GB RAM (same settings). While computing, the Mac Studio is pulling 100 watts of power.
  - josephg 4y ago
    Based on the screenshot, it looks like this is set to default to 25 steps. I've been using 50 steps on my M1 macbook pro with 16gb of ram. It takes about 1m30s per image.
  - drcongo 4y ago
    M1 Pro MBP with 32GB RAM here, takes 30 seconds on the default settings.
  - gardaani 4y ago
    > 55 seconds on a M1 Pro MacBook with 16GB RAM to generate a picture I've been running webui [1] on M1 MacBook Air 16GB RAM: 512x512, 50 steps takes almost 300 seconds. I'm suspecting that it is running on CPU, because the script says "Max VRAM used for this generation: 0.00G" and Activity Monitor says that it's using lots of CPU % and no GPU % at all. When M1 users are running stable diffusion, does the Activity Monitor show the GPU usage correctly? [1] https://github.com/lstein/stable-diffusion https://github.com/lstein/stable-diffusion
    - gardaani 4y ago
      I found the reason why it was using CPU only. I was running macOS 12.2. I upgraded to 12.5.1. and it's now using GPU. Activity Monitor shows it. Also, the time for 50 steps dropped to 175 secs. 25 steps is about 80 secs, which is closer to the MacBook Pro time..
andrewjrangel 4y ago
I can confirm that this works great on the M1 Max. It has been taking less than a minute to run the model and generate the images. So far I have been really satisfied with the output. Let's please make one-click installers the norm for future technology. I love nerding out, but wading through dependency hell is not worth it most of the time.
- Mystery-Machine 4y ago
  You're right. On top of that, python dependency / package management is a joke.
  - deleted 4y ago
    [deleted]
  - anothernewdude 4y ago
    Normally it's fine, but Apple have decided to force everyone into installing a conda python alongside normal python, which makes everything way more complicated than it needs to be.
    - hot_gril 4y ago
      It's bad either way. Should be easy like npm.
    - chipotle_coyote 4y ago
      I feel like I'm maybe missing some context here, because I've never had to install "conda Python" on any Mac ever. I had the system Python and a Homebrew-installed Python happily co-existing, and at various points have had "virtualized" Pythons installed via virtualenv or pipx. On Apple Silicon Macs there's no Python installed by default at all. Now, I've seen an awful lot of programs written in Python that decide to force you to install them with virtualenv or pipx, but that's not Apple's doing.
      - aivoyeur 4y ago
jrm4 4y ago
Guess I'll ask. Any Linux love here? AMD appreciated as well. Seems like maybe a job for an Appimage? Docker maybe?
- divamgupta 4y ago
  Work in progress!
- geuis 4y ago
  There are a couple decent videos on YouTube that walk through getting SD to run on Linux with AMD cards. The best one works with Arch but the same general steps should be compatible.
- asicsp 4y ago
  Check out https://github.com/cmdr2/stable-diffusion-ui https://github.com/cmdr2/stable-diffusion-ui
divamgupta 4y ago
Didn't realize that it will become #1 on HN. Thanks everyone. If you are on twitter and would like to share : https://twitter.com/divamgupta/status/1569014206912929796 https://twitter.com/divamgupta/status/1569014206912929796
aivoyeur 4y ago
This really is a one-click installer, which is excellent. As far as I know it's the first and only one for M1. It's quite a polished UI, but there are a lot of features missing. The first ones that come to mind are: - No way to specify a seed. This is an important part of SD workflows, letting you redo an image with a slightly tweaked a prompt. - No way to specify a custom model. Alternative models (such as Waifu Diffusion) are fun to play with too. - No way to generate batches of images. - No way to specify which sampler to use. - No way to adjust the weight of specific sub-phrases, or use negative weights. There's also no img2img yet, but it sounds like that's a planned feature. Other GUIs such as https://github.com/sd-webui/stable-diffusion-webui https://github.com/sd-webui/stable-diffusion-webui, https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui have many more features - but not all will be trivial to port to M1. P.S.: For the people asking - yes, it can do NSFW images. I checked.
- ihateolives 4y ago
  > This really is a one-click installer, which is excellent. As far as I know it's the first and only one for M1. There's https://www.charl-e.com/ https://www.charl-e.com/
  - aivoyeur 4y ago
    That's a very pretty landing page, but it entirely avoids describing any features, or showing what it looks like beyond a thumbnail-sized image. Do you have any insights?
    - ihateolives 4y ago
      Unfortunately, no, haven't had time to try it yet, bookmarked it few days ago. Just wanted to comment that there are others and probably will be many more coming shortly. I'm used to troubleshoot all kinds of stuff but I'm not a Python guy and wrangling with dependencies and virtual environments is not fun in my book. I've got lstein repo working but can't wait to have cleaner way of doing things.
    - 4y ago
TheMiddleMan 4y ago
Would love to see this turn into a cross-platform/cross-hardware AI art GUI+backend with an open source license. Speaking of which, what is the license on this? (the electron app)
holografix 4y ago
Is there an equivalent for Windows 10 + Nvidia GPU 8gB ram?
- tren 4y ago
  I've been using this with a Nvidia GPU with 6GB ram: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui https://github.com/n00mkrad/text2image-gui https://github.com/n00mkrad/text2image-gui
- swyx 4y ago
  https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_easytoinstall_windows_gui_for_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_...
latchkey 4y ago
For those of you following the lstein fork (especially the development branch), it has been making great progress. I'm not getting black images anymore and the speed has gone up significantly. Not one click install by a long shot, but the documentation is pretty clear to follow. Anyone with a bit of CLI experience can do it and if you don't have that, this is a great way to kind of stumble your way towards something working and learn in the process... https://github.com/lstein/stable-diffusion/tree/development/docs/installation https://github.com/lstein/stable-diffusion/tree/development/...
- capableweb 4y ago
  As a slightly shameless plug, I've been hacking up a UI specifically for that fork with a focus on a more efficient workflow for image synthesis. A demonstration video can be found here: https://vimeo.com/748114237 https://vimeo.com/748114237 If people have any sort of feedback I'd love to hear it, or if people have some specific features that are missing from the other UIs :)
  - hnarayanan 4y ago
    Bravo. This looks really promising and is exactly the sort of thing one needs to get models like these to generate what you imagine.
    - capableweb 4y ago
      Thank you so much! Really happy to hear. Hopefully I can do a Show HN in the future, when/if there is a free version for people to play around with, and get some really good feedback that way.
      - hnarayanan 4y ago
        Please do, I am sure you will get some good feedback.
  - Geee 4y ago
    Nice UI. Which GPU are you using? Seems to be really fast. I have 3090 and it's not that fast. 4 images with 20 timesteps takes 7.4 seconds.
heystefan 4y ago
Nice one. Too bad "image to image" is not available, as that's the one I'd like to experiment with the most.
tombert 4y ago
Does anyone have something for the Intel Macs?
- ayewo 4y ago
  Same question.
nappy 4y ago
Any benchmarks on this? How long does it take to generate a batch of images, say with steps=100?
- nl 4y ago
  On my M1 MAx with 32 GB I'm getting 1.5 iterations/second (ie, ~30 seconds for the standard 50 iterations) using this example: https://github.com/nlothian/m1_huggingface_diffusers_demo https://github.com/nlothian/m1_huggingface_diffusers_demo
  - zimpenfish 4y ago
    That's pretty good then - on my 3080, I'm getting ~8it/s.
idontwantthis 4y ago
Which settings are generating the best images for people?
abledon 4y ago
Anyone try it on a macbook air m1?
hsn915 4y ago
This requires macOS 12.5 but it doesn't seem like it's released? At least for my region? System preferences "Software updates" tab says I'm on the latest (12.4) and there are no updates for me to install. How am I supposed to try this?
- maxmcd 4y ago
  I have the same issue. 12.5.1 seems to have been released in August: https://9to5mac.com/2022/08/17/macos-12-5-1-monterey-security-fixes/ https://9to5mac.com/2022/08/17/macos-12-5-1-monterey-securit... What gives. edit: I went to the App Store and found the listing for Monterey and clicked "GET" which opened the software update dialog with 12.5.1 and the option to upgrade.
- vermilingua 4y ago
  I had the same issue (12.2.1), something seems to be borked with software update. Resolved by booting into safe mode, update showed up as expected.
- nathanasmith 4y ago
  Same here but after a reboot the option to upgrade to 12.6 appeared.
mark_l_watson 4y ago
Both of my M1 Macs only have 8G of RAM. Is it a waste of time trying to run this with 8G?
- pwinnski 4y ago
  Yes, it's a waste of time. It works, kinda, sorta, but only after shutting down every other app, and even then occasionally it seems to fall over. The model is larger than 8GB in memory, so it's agonizing.
  - zakki 4y ago
    What about 16MB RAM?
    - deleted 4y ago
      [deleted]
    - marktolson 4y ago
      16MB? No. 16GB? Sure.
    - pwinnski 4y ago
      My M1 Pro with 16GB handles it fine. My M1 with 8GB does not.
- yesenadam 4y ago
  I have a 2020 mac mini with 8GB RAM, an image takes about 7 minutes with the default settings, no problems so far.
  - Reason077 4y ago
    Oof. I guess I should at least 16GB on my next Mac (I've been very happy with 8GB on my M1 Air for just about everything else, though).
    - 4y ago
dzink 4y ago
Why cap it at 50 steps?
- mod 4y ago
  It stops changing.
  - capableweb 4y ago
    Depends on cfg scale and sampler. Sometimes 100 and 150 gives different results.
Karawebnetwork 4y ago
I've been using a one click installer for windows (grisk) to play with SD and so far I'm very impressed. The technology is there, you just need to tweak your prompts and the gui's setting to get whatever you want. The whole img2img too is awesome, you can simply and a quick sketch in paint (yes! paint!) and then feed it to SD. It'll output your exact idea in whatever style you want. We're at a turning point.
Karawebnetwork 4y ago
If anyone using this is getting bad results, it's probably your prompt that needs work. I recommend looking at https://lexica.art https://lexica.art for prompts (NSFW warning - unfiltered user generated data). It has the largest collection of results along with their prompts and a good search engine.
- stanislavb 4y ago
  Thanks. That's helpful.
- swyx 4y ago
  i've been putting together a guide to prompts here https://github.com/sw-yx/prompt-eng/blob/main/PROMPTS.md https://github.com/sw-yx/prompt-eng/blob/main/PROMPTS.md
- drexlspivey 4y ago
  How can I post my images to lexica.art ? I don’t see an upload option
  - Karawebnetwork 4y ago
    I am not sure, it could be that they are listening on tools that output result publicly (Midjouney's Discord bot for example). Edit: Yep, that's it: "you can't (yet) this is reiterated here like a 100 times at this point images and prompts were scraped from dicord bots on the official discord as there's no copyright on the images"
- Karawebnetwork 4y ago
  And also this one: https://generrated.com/ https://generrated.com/
nl 4y ago
I don't understand why all these crazy forks don't switch to using the HuggingFace codebase[1]. It's much better code and easier to add features to. It's true you have to use the code from git rather than a release, but that's not hard. https://github.com/nlothian/m1_huggingface_diffusers_demo https://github.com/nlothian/m1_huggingface_diffusers_demo is my clean demo repo with a notebook showing the usage. The standard HuggingFace examples (eg for img2img[2]) port across with no trouble too. [1] https://github.com/huggingface/diffusers https://github.com/huggingface/diffusers [2] https://github.com/huggingface/diffusers#image-to-image-text-guided-generation-with-stable-diffusion https://github.com/huggingface/diffusers#image-to-image-text...
- fragmede 4y ago
  Inertia, mostly. The official press release on August 10th linked to https://github.com/CompVis/stable-diffusion https://github.com/CompVis/stable-diffusion and diffusers didn't add support for Stable Diffusion until 5782e0393d on August 14th. There has been a ton of work on adding features on top of the CompVis Github release and backporting that work to Diffusers just isn't as interesting as adding new features to the existing fork. There has been some adoption of Diffusers though.
socialist_coder 4y ago
Why is "trending on artstation" a keyword that influences the ML model? seems weird
- capableweb 4y ago
  It's trained on a dataset that contains images together with text describing the image. Some images have been scraped from artstation, and if they were scraped from the "Trending" page, where well done images end up, it's included in the description. So by adding that to the prompt, you influence the image to be more similar to images that have been trending on artstation.
jithinraj 4y ago
Wow! Literally, the easiest way to install Stable Diffusion. It worked perfectly on my macOS Venture Beta build. Thank you. :)
can16358p 4y ago
Any plans for video support? If we can have "keyframes" with prompts that would output a PNG sequence or video, that would be awesome.
baal80spam 4y ago
Sometimes (~30%) I'm getting a black square. What can be the reason?
- drcongo 4y ago
  Same here.
jbverschoor 4y ago
Why does it need network access? Needs to download models. Will put it in your home dir btw.. in case you suddenly miss 5gb of storage
INGSOCIALITE 4y ago
Does this incorporate GFPGAN for face detection/cleaning and realesran for upscaling?
- dannyw 4y ago
  no
Orthanc 4y ago
What do the advanced options mean?
coldcode 4y ago
The prompt example shows "photrorealistic" which is unlikely to work well.
suref 4y ago
It’s fanatstic how quickly these models can be shared with anyone.
tomduncalf 4y ago
Pretty cool, generates an image in 17 seconds on my M1 Max with 64GB. Not sure how the quality compares, Dall-E seemed a bit more impressive from the small sample I've tried, but great to have it on your laptop.
Applejinx 4y ago
Looking forward to following this variant of Stable Diffusion, as it's working great on my laptop. Mighty glad I got the 16g of RAM, though I find if I step a canvas dimension down from 512 I get snappier generation… no biggie, anything I got that's useable I'd have to upscale anyway… Since it's a Mac app, I have to wonder if it could stick the prompt, steps, and guidance into the notes field of Get Info? I find I'm generating a lot of relatively low guidance (I'd love a 6.5 option) images and iterating on the prompts with an eye to what it's suggesting to the algorithm. As such I have no way to closely track what prompt was active on any output as it changes so often. I strongly suspect the real merit of this approach is not the crowd-pleasing, 'set very high guidance on some artistic trope so it's forced to fake something very impressive', but rather the ability to integrate a bunch of disparate guidances and occasionally hit on a striking image. It's like the harder you force it into a particular mold, the more derivative and stifled its output becomes, but if you let it free associate… I'll be experimenting. Seems like getting the occasional black image shows you're giving it the freest rein. Looking forward to 'image to image' a lot. I assume the prompt still matters, as it's fundamental to the diffusion denoising? Image to image means iterating on visual 'seeds'. I've seen talk of textual inversion training: it would interest me greatly to be able to generate objects and styles and train a personal version of SD in a sort of back-and-forth iteration. The link to language is really important here, but so is the ability to operate as an artist and generate drawings, aesthetics and so on, to train the model. I did 440 episodes of a hand-drawn webcomic once, which had recurring characters and an ink-wash grayscale style I gradually developed. That means I have my own dataset, which is my own property, and certainly didn't make it big enough to make it into Stable Diffusion like say Beeple did. Interesting times for the cybernetic artist. Basically computer-assisted hallucinatory unconscious, plus computer-assisted rendering. You could feed all of Cerebus (Dave Sim and Gerhard) into a model like this, panel by panel, and you'd probably get a hell of a lot of Gerhard out because so much of the panel area is tone and texture from him…
nojvek 4y ago
Open AI vs "OpenAI", very different things. The fact that I can do this on commodity hardware on a 4GB model. A model that understands text and visual images, just absolutely blows my mind. I almost feel like in a new future, a 100GB model may be able to offline handle speech -> text, video -> live scene graph. A robot that could base level physical understanding of our world like a 4 year old does. (objects, their relationship to other objects and behaviors)
deleted 4y ago
[deleted]

727 points by divamgupta 4y ago

Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed. Features: - Full data privacy - nothing is sent to the cloud - Clean and easy to use UI - One click installer - No dependencies needed - Multiple image sizes - Optimized for M1/M2 Chips - Runs locally on your computer

scsilver 4y ago
Thank you for this. How hard would this be to port to ipad?
- ShamelessC 4y ago
  Probably isn’t fast enough.
  - wlesieutre 4y ago
    The Pro and Air models have M1 chips, roughly on par with a MacBook Air
    - ShamelessC 4y ago
      Oh wow! Didn’t realize.
      - firecall 4y ago
        RAM might hold it back? Still, probably not too hard to build for iPad or iOS.
        Gigachad 4y ago
        The ipad pro has a 16gb option. It's essentially the same hardware as the macbook.
      - wlesieutre 4y ago
        iPad Pro got it in spring 2021, so an M2 refresh seems likely too. October event along with an M2 MacBook Pro refresh? Or maybe not until spring 2023. Another comment mentions RAM capabilities. Unfortunately that’s tied to the storage tiers instead of being something you can pick separately, so if you want 16 GB of RAM you have to buy the 1 TB or 2 TB models. Meaning for a 12.9” iPad Pro, if you want 16 GB you’re looking at an $1800 tablet. Not ideal.
jwuphysics 4y ago
Thanks for sharing. Can you say a little bit more about what prompted you to make this?
- divamgupta 4y ago
  Well, all the other offline tools seem didn't seem very intuitive to install, for someone without technical knowledge.
  - youssefabdelm 4y ago
    Even for someone with technical knowledge this is a breath of fresh air...why go through the trouble of even writing a script? I just wanna click a button and see something
keyle 4y ago
If it works, it's incredible!
- thrill 4y ago
  It works, well, incredibly.
  - fibonacc 4y ago
    how is this possible without a dedicated gPU? thought stable diffusion would require far more horsepower
    - happyopossum 4y ago
      M1s, especially the Max and Ultra, have pretty decent GPUs.
    - indigodaddy 4y ago
      They have integrated GPU that I believe Apple claimed was comparable to RTX 3090 (perhaps since debunked though or at the least maybe a misleading claim).
      - 10u152 4y ago
        I believe thats cherry picked data. More specifically apple says it’s comparable to the 3090x at a given power budget of 100 watts. They don’t mention that the 3090 goes up to 360 watts.
      - joakleaf 4y ago
        Apple compared M1 max to RTX 3080 (mobile) which was a stretch. M1 ultra was compared to RTX 3090 which was a larger stretch. The M1 max deliver about 10.5 tflops The M1 ultra about 21 tflops. The desktop RTX 3080 delivers about 30 tflops and RTX 3090 about 40. Apple’s comparison graph showed the speed of the M1s vs. RTXs at increasing power levels, with the M1s being more efficient at the same watt levels (which is probably true). However, since the graph stopped before the RTX GPUs reached full potential, the graph was somewhat misleading. The M1 max and Ultra have extra video processing modules that make them faster than the RTX GPUs at some video tasks though.
metadat 4y ago
Does it work with pornographic or potentially pornographic prompts?
- simondotau 4y ago
  And the real questions come out. Seriously though, I imagine this is less a case of whether this specific implementation permits pornography, but whether any porn was included in the dataset it was trained on. No matter how good AI is, it only knows what it knows.
  - metadat 4y ago
    Based on the upvotes, inquiring minds _really want to know_!
    - indigodaddy 4y ago
      How do you see upvotes? I’ve never had any visibility to upvoted comments (downvoted of course yes), or at least it’s not obvious at all to me and see no indication of it..
      - gpm 4y ago
        You can see the total score (upvotes - downovtes) for your comment where you see the upvote/downvote button for everyone else's comments. Or at least I can.
    - Tagbert 4y ago
      I’ve always been curious about that, too. I don’t think I see anyone else’s votes, up or down.
    - josephg 4y ago
      It can make porn images, but I haven't been able to get consistently good results. There's probably ways to tweak the parameters to improve things, but I haven't figured that out. It mostly understands what naked people look like, but the images I've generated involve a lot of accidental body horror. You get a lot of people with extra arms, weird eyes, or body parts in the wrong places. The fact that they explicitly removed porn from the training set comes through pretty clearly in the model. I suspect it could be improved a lot with some specialized retraining. As far as I know, nobody has done that work yet.
swyx 4y ago
do you mind putting a license on your repo? as it is right now Diffusion Bee is technically not open source.

keizo 4y ago

amazing, look forward to trying it out. has anyone done the same for windows?

fragmede 4y ago
Yes: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui No idea if it supports AMD GPUs though.
- KaoruAoiShiho 4y ago
  Do you have any info on perf compared to this: https://news.ycombinator.com/item?id=32805174 https://news.ycombinator.com/item?id=32805174
  - fragmede 4y ago
    More optimization work has and is going into Nvidia support, so those are currently faster. Pytorch support for MPS devices is relatively new, so there's a ton of optimization that hasn't been done yet, so it's not clear which underlying hardware is actually faster for this specific task, but it looks like the top end Apple Silicon is in the same bracket as a consumer-grade Nvidia GPU.
    - dannyw 4y ago
      My consumer 3060 does 7.2 it/s, which is 5x faster than the M2. Sorry, Apple is nowhere close yet.
  - zimpenfish 4y ago
    Just done a run on my 3080 under Windows using https://github.com/bfirsh/stable-diffusion.git https://github.com/bfirsh/stable-diffusion.git and it's about 8 iterations/sec when nothing else is using CPU or GPU.
- nuclearsugar 4y ago
  Thanks for this, exactly what I was looking for

andrei_says_ 4y ago

Has anyone looked at the code and verified the statements in the readme?

ShamelessC 4y ago
Why not just do this yourself before commenting?
- ralusek 4y ago
  Because this is a community, and I appreciate having had the question asked and answered, as do many others I'm sure.
float4 4y ago
Ran it with Little Snitch installed (why bother looking at the code when a malicious actor can just upload a modified binary anyway?) and the claims seem to be legit so far.
- ralusek 4y ago
  Presumably need to look at code, build code, and compare binaries.

toomuchtodo 4y ago

Thank you for this public service OP! Might consider adding “Show HN” to the prefix if you’ve got the characters left.

ryatkins 4y ago

Can you support MacOS Monterey 12.4? You're only supporting Ventura 12.5+ and it isn't even released yet.

donut2d 4y ago
12.5.1 is the latest, non-beta release. That's still Monterey. Ventura will be 13.x.

indigodaddy 4y ago

How long is the generation taking on say a 2021 MacBook M1 Pro?

deleted 4y ago
[deleted]
andreasley 4y ago
55 seconds on a M1 Pro MacBook with 16GB RAM to generate a picture (with default settings, so 512x512, 25 steps). On a M1 Ultra, it takes 12 seconds with 64GB RAM (same settings). While computing, the Mac Studio is pulling 100 watts of power.
- josephg 4y ago
  Based on the screenshot, it looks like this is set to default to 25 steps. I've been using 50 steps on my M1 macbook pro with 16gb of ram. It takes about 1m30s per image.
- drcongo 4y ago
  M1 Pro MBP with 32GB RAM here, takes 30 seconds on the default settings.
- gardaani 4y ago
  > 55 seconds on a M1 Pro MacBook with 16GB RAM to generate a picture I've been running webui [1] on M1 MacBook Air 16GB RAM: 512x512, 50 steps takes almost 300 seconds. I'm suspecting that it is running on CPU, because the script says "Max VRAM used for this generation: 0.00G" and Activity Monitor says that it's using lots of CPU % and no GPU % at all. When M1 users are running stable diffusion, does the Activity Monitor show the GPU usage correctly? [1] https://github.com/lstein/stable-diffusion https://github.com/lstein/stable-diffusion
  - gardaani 4y ago
    I found the reason why it was using CPU only. I was running macOS 12.2. I upgraded to 12.5.1. and it's now using GPU. Activity Monitor shows it. Also, the time for 50 steps dropped to 175 secs. 25 steps is about 80 secs, which is closer to the MacBook Pro time..

andrewjrangel 4y ago

I can confirm that this works great on the M1 Max. It has been taking less than a minute to run the model and generate the images. So far I have been really satisfied with the output. Let's please make one-click installers the norm for future technology. I love nerding out, but wading through dependency hell is not worth it most of the time.

Mystery-Machine 4y ago
You're right. On top of that, python dependency / package management is a joke.
- deleted 4y ago
  [deleted]
- anothernewdude 4y ago
  Normally it's fine, but Apple have decided to force everyone into installing a conda python alongside normal python, which makes everything way more complicated than it needs to be.
  - hot_gril 4y ago
    It's bad either way. Should be easy like npm.
  - chipotle_coyote 4y ago
    I feel like I'm maybe missing some context here, because I've never had to install "conda Python" on any Mac ever. I had the system Python and a Homebrew-installed Python happily co-existing, and at various points have had "virtualized" Pythons installed via virtualenv or pipx. On Apple Silicon Macs there's no Python installed by default at all. Now, I've seen an awful lot of programs written in Python that decide to force you to install them with virtualenv or pipx, but that's not Apple's doing.
    - aivoyeur 4y ago

jrm4 4y ago

Guess I'll ask. Any Linux love here? AMD appreciated as well. Seems like maybe a job for an Appimage? Docker maybe?

divamgupta 4y ago
Work in progress!
geuis 4y ago
There are a couple decent videos on YouTube that walk through getting SD to run on Linux with AMD cards. The best one works with Arch but the same general steps should be compatible.
asicsp 4y ago
Check out https://github.com/cmdr2/stable-diffusion-ui https://github.com/cmdr2/stable-diffusion-ui

divamgupta 4y ago

Didn't realize that it will become #1 on HN. Thanks everyone. If you are on twitter and would like to share : https://twitter.com/divamgupta/status/1569014206912929796 https://twitter.com/divamgupta/status/1569014206912929796

aivoyeur 4y ago

This really is a one-click installer, which is excellent. As far as I know it's the first and only one for M1. It's quite a polished UI, but there are a lot of features missing. The first ones that come to mind are: - No way to specify a seed. This is an important part of SD workflows, letting you redo an image with a slightly tweaked a prompt. - No way to specify a custom model. Alternative models (such as Waifu Diffusion) are fun to play with too. - No way to generate batches of images. - No way to specify which sampler to use. - No way to adjust the weight of specific sub-phrases, or use negative weights. There's also no img2img yet, but it sounds like that's a planned feature. Other GUIs such as https://github.com/sd-webui/stable-diffusion-webui https://github.com/sd-webui/stable-diffusion-webui, https://github.com/AUTOMATIC1111/stable-diffusion-webui https://github.com/AUTOMATIC1111/stable-diffusion-webui have many more features - but not all will be trivial to port to M1. P.S.: For the people asking - yes, it can do NSFW images. I checked.

ihateolives 4y ago
> This really is a one-click installer, which is excellent. As far as I know it's the first and only one for M1. There's https://www.charl-e.com/ https://www.charl-e.com/
- aivoyeur 4y ago
  That's a very pretty landing page, but it entirely avoids describing any features, or showing what it looks like beyond a thumbnail-sized image. Do you have any insights?
  - ihateolives 4y ago
    Unfortunately, no, haven't had time to try it yet, bookmarked it few days ago. Just wanted to comment that there are others and probably will be many more coming shortly. I'm used to troubleshoot all kinds of stuff but I'm not a Python guy and wrangling with dependencies and virtual environments is not fun in my book. I've got lstein repo working but can't wait to have cleaner way of doing things.
  - 4y ago

TheMiddleMan 4y ago

Would love to see this turn into a cross-platform/cross-hardware AI art GUI+backend with an open source license. Speaking of which, what is the license on this? (the electron app)

holografix 4y ago

Is there an equivalent for Windows 10 + Nvidia GPU 8gB ram?

tren 4y ago
I've been using this with a Nvidia GPU with 6GB ram: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui https://github.com/n00mkrad/text2image-gui https://github.com/n00mkrad/text2image-gui
swyx 4y ago
https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_easytoinstall_windows_gui_for_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_...

latchkey 4y ago

For those of you following the lstein fork (especially the development branch), it has been making great progress. I'm not getting black images anymore and the speed has gone up significantly. Not one click install by a long shot, but the documentation is pretty clear to follow. Anyone with a bit of CLI experience can do it and if you don't have that, this is a great way to kind of stumble your way towards something working and learn in the process... https://github.com/lstein/stable-diffusion/tree/development/docs/installation https://github.com/lstein/stable-diffusion/tree/development/...

capableweb 4y ago
As a slightly shameless plug, I've been hacking up a UI specifically for that fork with a focus on a more efficient workflow for image synthesis. A demonstration video can be found here: https://vimeo.com/748114237 https://vimeo.com/748114237 If people have any sort of feedback I'd love to hear it, or if people have some specific features that are missing from the other UIs :)
- hnarayanan 4y ago
  Bravo. This looks really promising and is exactly the sort of thing one needs to get models like these to generate what you imagine.
  - capableweb 4y ago
    Thank you so much! Really happy to hear. Hopefully I can do a Show HN in the future, when/if there is a free version for people to play around with, and get some really good feedback that way.
    - hnarayanan 4y ago
      Please do, I am sure you will get some good feedback.
- Geee 4y ago
  Nice UI. Which GPU are you using? Seems to be really fast. I have 3090 and it's not that fast. 4 images with 20 timesteps takes 7.4 seconds.

heystefan 4y ago

Nice one. Too bad "image to image" is not available, as that's the one I'd like to experiment with the most.

tombert 4y ago

Does anyone have something for the Intel Macs?

ayewo 4y ago
Same question.

nappy 4y ago

Any benchmarks on this? How long does it take to generate a batch of images, say with steps=100?

nl 4y ago
On my M1 MAx with 32 GB I'm getting 1.5 iterations/second (ie, ~30 seconds for the standard 50 iterations) using this example: https://github.com/nlothian/m1_huggingface_diffusers_demo https://github.com/nlothian/m1_huggingface_diffusers_demo
- zimpenfish 4y ago
  That's pretty good then - on my 3080, I'm getting ~8it/s.

idontwantthis 4y ago

Which settings are generating the best images for people?

abledon 4y ago

Anyone try it on a macbook air m1?

hsn915 4y ago

This requires macOS 12.5 but it doesn't seem like it's released? At least for my region? System preferences "Software updates" tab says I'm on the latest (12.4) and there are no updates for me to install. How am I supposed to try this?

maxmcd 4y ago
I have the same issue. 12.5.1 seems to have been released in August: https://9to5mac.com/2022/08/17/macos-12-5-1-monterey-security-fixes/ https://9to5mac.com/2022/08/17/macos-12-5-1-monterey-securit... What gives. edit: I went to the App Store and found the listing for Monterey and clicked "GET" which opened the software update dialog with 12.5.1 and the option to upgrade.
vermilingua 4y ago
I had the same issue (12.2.1), something seems to be borked with software update. Resolved by booting into safe mode, update showed up as expected.
nathanasmith 4y ago
Same here but after a reboot the option to upgrade to 12.6 appeared.

mark_l_watson 4y ago

Both of my M1 Macs only have 8G of RAM. Is it a waste of time trying to run this with 8G?

pwinnski 4y ago
Yes, it's a waste of time. It works, kinda, sorta, but only after shutting down every other app, and even then occasionally it seems to fall over. The model is larger than 8GB in memory, so it's agonizing.
- zakki 4y ago
  What about 16MB RAM?
  - deleted 4y ago
    [deleted]
  - marktolson 4y ago
    16MB? No. 16GB? Sure.
  - pwinnski 4y ago
    My M1 Pro with 16GB handles it fine. My M1 with 8GB does not.
yesenadam 4y ago
I have a 2020 mac mini with 8GB RAM, an image takes about 7 minutes with the default settings, no problems so far.
- Reason077 4y ago
  Oof. I guess I should at least 16GB on my next Mac (I've been very happy with 8GB on my M1 Air for just about everything else, though).
  - 4y ago

dzink 4y ago

Why cap it at 50 steps?

mod 4y ago
It stops changing.
- capableweb 4y ago
  Depends on cfg scale and sampler. Sometimes 100 and 150 gives different results.

Karawebnetwork 4y ago

I've been using a one click installer for windows (grisk) to play with SD and so far I'm very impressed. The technology is there, you just need to tweak your prompts and the gui's setting to get whatever you want. The whole img2img too is awesome, you can simply and a quick sketch in paint (yes! paint!) and then feed it to SD. It'll output your exact idea in whatever style you want. We're at a turning point.

Karawebnetwork 4y ago

If anyone using this is getting bad results, it's probably your prompt that needs work. I recommend looking at https://lexica.art https://lexica.art for prompts (NSFW warning - unfiltered user generated data). It has the largest collection of results along with their prompts and a good search engine.

stanislavb 4y ago
Thanks. That's helpful.
swyx 4y ago
i've been putting together a guide to prompts here https://github.com/sw-yx/prompt-eng/blob/main/PROMPTS.md https://github.com/sw-yx/prompt-eng/blob/main/PROMPTS.md
drexlspivey 4y ago
How can I post my images to lexica.art ? I don’t see an upload option
- Karawebnetwork 4y ago
  I am not sure, it could be that they are listening on tools that output result publicly (Midjouney's Discord bot for example). Edit: Yep, that's it: "you can't (yet) this is reiterated here like a 100 times at this point images and prompts were scraped from dicord bots on the official discord as there's no copyright on the images"
Karawebnetwork 4y ago
And also this one: https://generrated.com/ https://generrated.com/

nl 4y ago

I don't understand why all these crazy forks don't switch to using the HuggingFace codebase[1]. It's much better code and easier to add features to. It's true you have to use the code from git rather than a release, but that's not hard. https://github.com/nlothian/m1_huggingface_diffusers_demo https://github.com/nlothian/m1_huggingface_diffusers_demo is my clean demo repo with a notebook showing the usage. The standard HuggingFace examples (eg for img2img[2]) port across with no trouble too. [1] https://github.com/huggingface/diffusers https://github.com/huggingface/diffusers [2] https://github.com/huggingface/diffusers#image-to-image-text-guided-generation-with-stable-diffusion https://github.com/huggingface/diffusers#image-to-image-text...

fragmede 4y ago
Inertia, mostly. The official press release on August 10th linked to https://github.com/CompVis/stable-diffusion https://github.com/CompVis/stable-diffusion and diffusers didn't add support for Stable Diffusion until 5782e0393d on August 14th. There has been a ton of work on adding features on top of the CompVis Github release and backporting that work to Diffusers just isn't as interesting as adding new features to the existing fork. There has been some adoption of Diffusers though.

socialist_coder 4y ago

Why is "trending on artstation" a keyword that influences the ML model? seems weird

capableweb 4y ago
It's trained on a dataset that contains images together with text describing the image. Some images have been scraped from artstation, and if they were scraped from the "Trending" page, where well done images end up, it's included in the description. So by adding that to the prompt, you influence the image to be more similar to images that have been trending on artstation.

jithinraj 4y ago

Wow! Literally, the easiest way to install Stable Diffusion. It worked perfectly on my macOS Venture Beta build. Thank you. :)

can16358p 4y ago

Any plans for video support? If we can have "keyframes" with prompts that would output a PNG sequence or video, that would be awesome.

baal80spam 4y ago

Sometimes (~30%) I'm getting a black square. What can be the reason?

drcongo 4y ago
Same here.

jbverschoor 4y ago

Why does it need network access? Needs to download models. Will put it in your home dir btw.. in case you suddenly miss 5gb of storage

INGSOCIALITE 4y ago

Does this incorporate GFPGAN for face detection/cleaning and realesran for upscaling?

dannyw 4y ago
no

Orthanc 4y ago

What do the advanced options mean?

coldcode 4y ago

The prompt example shows "photrorealistic" which is unlikely to work well.

suref 4y ago

It’s fanatstic how quickly these models can be shared with anyone.

tomduncalf 4y ago

Pretty cool, generates an image in 17 seconds on my M1 Max with 64GB. Not sure how the quality compares, Dall-E seemed a bit more impressive from the small sample I've tried, but great to have it on your laptop.

Applejinx 4y ago

Looking forward to following this variant of Stable Diffusion, as it's working great on my laptop. Mighty glad I got the 16g of RAM, though I find if I step a canvas dimension down from 512 I get snappier generation… no biggie, anything I got that's useable I'd have to upscale anyway… Since it's a Mac app, I have to wonder if it could stick the prompt, steps, and guidance into the notes field of Get Info? I find I'm generating a lot of relatively low guidance (I'd love a 6.5 option) images and iterating on the prompts with an eye to what it's suggesting to the algorithm. As such I have no way to closely track what prompt was active on any output as it changes so often. I strongly suspect the real merit of this approach is not the crowd-pleasing, 'set very high guidance on some artistic trope so it's forced to fake something very impressive', but rather the ability to integrate a bunch of disparate guidances and occasionally hit on a striking image. It's like the harder you force it into a particular mold, the more derivative and stifled its output becomes, but if you let it free associate… I'll be experimenting. Seems like getting the occasional black image shows you're giving it the freest rein. Looking forward to 'image to image' a lot. I assume the prompt still matters, as it's fundamental to the diffusion denoising? Image to image means iterating on visual 'seeds'. I've seen talk of textual inversion training: it would interest me greatly to be able to generate objects and styles and train a personal version of SD in a sort of back-and-forth iteration. The link to language is really important here, but so is the ability to operate as an artist and generate drawings, aesthetics and so on, to train the model. I did 440 episodes of a hand-drawn webcomic once, which had recurring characters and an ink-wash grayscale style I gradually developed. That means I have my own dataset, which is my own property, and certainly didn't make it big enough to make it into Stable Diffusion like say Beeple did. Interesting times for the cybernetic artist. Basically computer-assisted hallucinatory unconscious, plus computer-assisted rendering. You could feed all of Cerebus (Dave Sim and Gerhard) into a model like this, panel by panel, and you'd probably get a hell of a lot of Gerhard out because so much of the panel area is tone and texture from him…

nojvek 4y ago

Open AI vs "OpenAI", very different things. The fact that I can do this on commodity hardware on a 4GB model. A model that understands text and visual images, just absolutely blows my mind. I almost feel like in a new future, a 100GB model may be able to offline handle speech -> text, video -> live scene graph. A robot that could base level physical understanding of our world like a 4 year old does. (objects, their relationship to other objects and behaviors)

deleted 4y ago

[deleted]