6 ms·

Stable Diffusion is arguably better, has more features, and is free. OpenAI can't compete with free. Even if you don't want to take the 30 seconds to set it up

Stable Diffusion is arguably better, has more features, and is free. OpenAI can't compete with free. Even if you don't want to take the 30 seconds to set it up in a free Google Colab environment, the paid DreamStudio version is still half the price of Dalle.

slig 4y ago
Do you know the best Google Colab tutorial / repo?
- cmdr2 4y ago
  Hi, there are a couple of good UIs. https://github.com/cmdr2/stable-diffusion-ui https://github.com/cmdr2/stable-diffusion-ui is an easy-to-install and use tool, written by me (with contributions by many). Version 2 is in beta, which is a 1-click installer for Windows, no dependencies or command line needed. v2 beta: https://github.com/cmdr2/stable-diffusion-ui/tree/v2 https://github.com/cmdr2/stable-diffusion-ui/tree/v2 https://github.com/hlky/stable-diffusion https://github.com/hlky/stable-diffusion is another popular and good tool.
  - slig 4y ago
    Thank you!
  - adamsmith143 4y ago
    I'm impressed how fast this is getting adopted. Dozens of repos have popped up.
  - _joel 4y ago
    Any of these that work work with apple arm64 m2?
  - tsol 4y ago
    Awesome, thanks a lot!
ajkshdfgkjasdh 4y ago
dreamstudio is also waaaay faster than openai. generally a second or two for 512x512 at 50 steps.
scifibestfi 4y ago
Stable Diffusion is much less of a nanny too. Amusingly it's more open in every way.
frognumber 4y ago
I find Stable Diffusion better overall, but it has downsides. Stable Diffusion tends to be more creative than DALL-E, but does a lousy job of following directions, especially complex ones. DALL-E is good if I know what I want specifically. I can think of ways to fix Stable Diffusion since it's open-source. I think I could bridge the gaps as I see them in about a weekend of hacking. I'm not sure when I'll get that weekend. (Footnote: What I want to do is not something I can explain without a technical blog-post-length document or a zoom call; it's about the same level of complexity as the other major SD hacks we've seen)
- cube2222 4y ago
  Setting a high cfg parameter, like 13, drastically helps with the prompt following. That said, for me, I agree that dalle does much better pencil sketches.
  - astrange 4y ago
    Raising the cfg ("classifier-free guidance") scale is essential for following the prompt, but if you raise it too high the image gets weird and saturated. According to Google's Imagen paper this is literally because the pixels get multiplied by the cfg scale and start clipping; they have a technique called dynamic thresholding that replaces it. Not sure if SD uses this, but I saw Emad hinting they were training an Imagen model…
- Miraste 4y ago
  Something like prompt weighting? I've seen implementations of that floating around.
bottlepalm 4y ago
There was a good example somewhere I can’t find, but of a really complex prompt that Dalle could understand, but SD couldn’t. Maybe some of the GPT-3 is being leveraged for parsing. Anyways I think it’s way too early to start taking sides. I enjoy using all these system.
- bioemerl 4y ago
  One of SDs big limitations (understanding from what I had read about it) is positional prompts. dall-e seems to understand x on top of Y, but simple diffusion does not.
  - posterboy 4y ago
    Ironically, "the cat is on the mat" is a conventional example sentence in linguistics of metonymy (semantics). I have no examples but imagine things like at the top of his game are immensely problematic, albeit not very visual to begin with.
  - adamsmith143 4y ago
    Doesnt seem to get IN examples either. E.g. a prompt like 'an eagle holding a snake in its beak' ends up generating eagle snake hybrid creatures.
  - dogcomplex 4y ago
    img2img drawing should take care of that
    - bioemerl 4y ago
      I'm experimenting with the base model right now, I'm going to be very excited to try that one out too.
yreg 4y ago
I don't think Stable Diffusion is technologically better yet. Sure, both SD and Midjourney produce absolutely beautiful artworks most of the time. But if you want something specific and out of the ordinary it takes a lot of attempts and promptcrafting (and sometimes you are unable to accomplish what you want at all). However, my experience is that these prompts (which SD/MJ struggles with) often produce good results in Dalle2 even on the first try. Of course, OpenAI has very limiting content policy. But if I have something very specific in mind and it passes their rules I currently chose Dalle-2. Even though I've spent much more time with SD.
- istsp 4y ago
  Note that Dalle2 uses CLIP guidance while SD doesn't, it is a feature that will be added soon and can already be added by users if they want although im not sure how easy it is. MidJourney has already shown theyve implemented it in their beta using stable diffusion and it make the results 200% better trust me
skybrian 4y ago
Running this at home is only free like mining cryptocurrency is free if you didn't buy your computer and don't pay for the electricity. Plus you can only run it on the computer that has the good graphics card, which probably isn't your laptop. I expect most people aren't going to be generating images all day, so using a cloud-based service for occasional use will still make a lot of sense. Stable Diffusion offers a paid service to do this too, and there's nothing wrong with that business model. Prices will probably come down, though.
- Tepix 4y ago
  It does run on Apple silicon. 55 seconds in M1 Pro (vs 15 seconds on RTX 3070).
  - redler 4y ago
    Is this native? Or Rosetta?
    - Miraste 4y ago
      Native, and judging by the speed it's using Metal too (as opposed to CPU fallback).
  - istsp 4y ago
    it will be faster soon as Emad said there was issues with the ISA for the gpu not being fully ported or something of the sort
  - skybrian 4y ago
    That's pretty good, but with that level of latency, I can still see people paying to use an online service that's faster. Maybe they'll speed it up more, though?
- bornfreddy 4y ago
  Not sure if GP had this in mind, but SD is (more) free in terms of liberty. So yes, you pay with electricity and hardware, but you control the process yourself, which is invaluable. DALL-E could change or go offline at any time.
irrational 4y ago
Better in what way? I tried 10 prompts that returned good results in DALLE, but nothing good in stable diffusion.
- davidwparker 4y ago
  Seconded. I got awesome results in making "artwork in the style of Yoshitaka Amano" in DALLE but horrible ones in Stable Diffusion. Maybe the prompt was incorrect there (it would be great if these were more discoverable), but they art in SD was lacking.
  - andybak 4y ago
    SD definitely needs more coaxing and naive prompts tend not to fare as well as with Dall-E.
DeWilde 4y ago
Also, unlike DALL-E, SD comes without a content filter and "anti-bias diversity" filter so it gives you what you ask and treats you as an adult.
- nmfisher 4y ago
  There's still a NSFW filter (at least, in the version I used). I'm sure it's easy enough to disable if you poke around but it's not exposed as a function parameter out-of-the-box. I didn't investigate any further because I'm not actively trying to generate porn. It was pretty annoying to have my results blanked out because they were (apparently) NSFW - so either the filter was triggering a lot of false positives or the model was generating NSFW content for non-NSFW prompts.
  - MacsHeadroom 4y ago
    After removing the NSFW filter, I can confirm that 99% of the blocked results are not in-fact NSFW. The filter is VERY over aggressive. To remove the filter, you just have to comment out the two lines of code which call it. Instructions are here: https://reddit.com/r/StableDiffusion/comments/wv2nw0/tutorial_how_to_remove_the_safety_filter_in_5/ https://reddit.com/r/StableDiffusion/comments/wv2nw0/tutoria...
iKlsR 4y ago
After many months of waiting on my invite I got it and I entered the prompt which is my greatest fear for some reason "a red eyed hairy spider with human hands as feet" I got a warning about violating policy/harmful content etc or something. Not only that, the results I got were super underwhelming, after playing with it for a half hour I haven't looked back. Now playing with SD and an upscaler, there is no limit to what I can create. Also I always found it funny the company name hilarious. "Open"AI.

slig 4y ago

Do you know the best Google Colab tutorial / repo?

cmdr2 4y ago
Hi, there are a couple of good UIs. https://github.com/cmdr2/stable-diffusion-ui https://github.com/cmdr2/stable-diffusion-ui is an easy-to-install and use tool, written by me (with contributions by many). Version 2 is in beta, which is a 1-click installer for Windows, no dependencies or command line needed. v2 beta: https://github.com/cmdr2/stable-diffusion-ui/tree/v2 https://github.com/cmdr2/stable-diffusion-ui/tree/v2 https://github.com/hlky/stable-diffusion https://github.com/hlky/stable-diffusion is another popular and good tool.
- slig 4y ago
  Thank you!
- adamsmith143 4y ago
  I'm impressed how fast this is getting adopted. Dozens of repos have popped up.
- _joel 4y ago
  Any of these that work work with apple arm64 m2?
- tsol 4y ago
  Awesome, thanks a lot!

ajkshdfgkjasdh 4y ago

dreamstudio is also waaaay faster than openai. generally a second or two for 512x512 at 50 steps.

scifibestfi 4y ago

Stable Diffusion is much less of a nanny too. Amusingly it's more open in every way.

frognumber 4y ago

I find Stable Diffusion better overall, but it has downsides. Stable Diffusion tends to be more creative than DALL-E, but does a lousy job of following directions, especially complex ones. DALL-E is good if I know what I want specifically. I can think of ways to fix Stable Diffusion since it's open-source. I think I could bridge the gaps as I see them in about a weekend of hacking. I'm not sure when I'll get that weekend. (Footnote: What I want to do is not something I can explain without a technical blog-post-length document or a zoom call; it's about the same level of complexity as the other major SD hacks we've seen)

cube2222 4y ago
Setting a high cfg parameter, like 13, drastically helps with the prompt following. That said, for me, I agree that dalle does much better pencil sketches.
- astrange 4y ago
  Raising the cfg ("classifier-free guidance") scale is essential for following the prompt, but if you raise it too high the image gets weird and saturated. According to Google's Imagen paper this is literally because the pixels get multiplied by the cfg scale and start clipping; they have a technique called dynamic thresholding that replaces it. Not sure if SD uses this, but I saw Emad hinting they were training an Imagen model…
Miraste 4y ago
Something like prompt weighting? I've seen implementations of that floating around.

bottlepalm 4y ago

There was a good example somewhere I can’t find, but of a really complex prompt that Dalle could understand, but SD couldn’t. Maybe some of the GPT-3 is being leveraged for parsing. Anyways I think it’s way too early to start taking sides. I enjoy using all these system.

bioemerl 4y ago
One of SDs big limitations (understanding from what I had read about it) is positional prompts. dall-e seems to understand x on top of Y, but simple diffusion does not.
- posterboy 4y ago
  Ironically, "the cat is on the mat" is a conventional example sentence in linguistics of metonymy (semantics). I have no examples but imagine things like at the top of his game are immensely problematic, albeit not very visual to begin with.
- adamsmith143 4y ago
  Doesnt seem to get IN examples either. E.g. a prompt like 'an eagle holding a snake in its beak' ends up generating eagle snake hybrid creatures.
- dogcomplex 4y ago
  img2img drawing should take care of that
  - bioemerl 4y ago
    I'm experimenting with the base model right now, I'm going to be very excited to try that one out too.

yreg 4y ago

I don't think Stable Diffusion is technologically better yet. Sure, both SD and Midjourney produce absolutely beautiful artworks most of the time. But if you want something specific and out of the ordinary it takes a lot of attempts and promptcrafting (and sometimes you are unable to accomplish what you want at all). However, my experience is that these prompts (which SD/MJ struggles with) often produce good results in Dalle2 even on the first try. Of course, OpenAI has very limiting content policy. But if I have something very specific in mind and it passes their rules I currently chose Dalle-2. Even though I've spent much more time with SD.

istsp 4y ago
Note that Dalle2 uses CLIP guidance while SD doesn't, it is a feature that will be added soon and can already be added by users if they want although im not sure how easy it is. MidJourney has already shown theyve implemented it in their beta using stable diffusion and it make the results 200% better trust me

skybrian 4y ago

Running this at home is only free like mining cryptocurrency is free if you didn't buy your computer and don't pay for the electricity. Plus you can only run it on the computer that has the good graphics card, which probably isn't your laptop. I expect most people aren't going to be generating images all day, so using a cloud-based service for occasional use will still make a lot of sense. Stable Diffusion offers a paid service to do this too, and there's nothing wrong with that business model. Prices will probably come down, though.

Tepix 4y ago
It does run on Apple silicon. 55 seconds in M1 Pro (vs 15 seconds on RTX 3070).
- redler 4y ago
  Is this native? Or Rosetta?
  - Miraste 4y ago
    Native, and judging by the speed it's using Metal too (as opposed to CPU fallback).
- istsp 4y ago
  it will be faster soon as Emad said there was issues with the ISA for the gpu not being fully ported or something of the sort
- skybrian 4y ago
  That's pretty good, but with that level of latency, I can still see people paying to use an online service that's faster. Maybe they'll speed it up more, though?
bornfreddy 4y ago
Not sure if GP had this in mind, but SD is (more) free in terms of liberty. So yes, you pay with electricity and hardware, but you control the process yourself, which is invaluable. DALL-E could change or go offline at any time.

irrational 4y ago

Better in what way? I tried 10 prompts that returned good results in DALLE, but nothing good in stable diffusion.

davidwparker 4y ago
Seconded. I got awesome results in making "artwork in the style of Yoshitaka Amano" in DALLE but horrible ones in Stable Diffusion. Maybe the prompt was incorrect there (it would be great if these were more discoverable), but they art in SD was lacking.
- andybak 4y ago
  SD definitely needs more coaxing and naive prompts tend not to fare as well as with Dall-E.

DeWilde 4y ago

Also, unlike DALL-E, SD comes without a content filter and "anti-bias diversity" filter so it gives you what you ask and treats you as an adult.

nmfisher 4y ago
There's still a NSFW filter (at least, in the version I used). I'm sure it's easy enough to disable if you poke around but it's not exposed as a function parameter out-of-the-box. I didn't investigate any further because I'm not actively trying to generate porn. It was pretty annoying to have my results blanked out because they were (apparently) NSFW - so either the filter was triggering a lot of false positives or the model was generating NSFW content for non-NSFW prompts.
- MacsHeadroom 4y ago
  After removing the NSFW filter, I can confirm that 99% of the blocked results are not in-fact NSFW. The filter is VERY over aggressive. To remove the filter, you just have to comment out the two lines of code which call it. Instructions are here: https://reddit.com/r/StableDiffusion/comments/wv2nw0/tutorial_how_to_remove_the_safety_filter_in_5/ https://reddit.com/r/StableDiffusion/comments/wv2nw0/tutoria...

iKlsR 4y ago

After many months of waiting on my invite I got it and I entered the prompt which is my greatest fear for some reason "a red eyed hairy spider with human hands as feet" I got a warning about violating policy/harmful content etc or something. Not only that, the results I got were super underwhelming, after playing with it for a half hour I haven't looked back. Now playing with SD and an upscaler, there is no limit to what I can create. Also I always found it funny the company name hilarious. "Open"AI.