7 ms·

Meanwhile someone has already built a photoshop plugin for Stable Diffusion that you can use today to do basically the _exact_ same thing: https://old.reddit.c

Meanwhile someone has already built a photoshop plugin for Stable Diffusion that you can use today to do basically the _exact_ same thing: https://old.reddit.com/r/StableDiffusion/comments/wyduk1/show_rstablediffusion_integrating_sd_in_photoshop/ https://old.reddit.com/r/StableDiffusion/comments/wyduk1/sho...

nabakin 4y ago
Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. I can only guess either safety from misuse or leveraging it for money. At this rate though, Stable Diffusion is going to dwarf it
- amelius 4y ago
  Wasn't OpenAI supposed to "democratize deep learning"? It seems more like they were trying to accomplish the opposite.
  - wahnfrieden 4y ago
    It's in their interest to posture that way publicly while controlling scarcity of access where there's financial upside to
    - thethimble 4y ago
      Exclusively licensing GPT-3 to Microsoft seems like a clear example of this. https://www.technologyreview.com/2020/09/23/1008729/openai-is-giving-microsoft-exclusive-access-to-its-gpt-3-language-model/ https://www.technologyreview.com/2020/09/23/1008729/openai-i...
  - visarga 4y ago
    Elites for democracy! With their elite studies and abilities they will democratise AI by teaching it what is right and wrong. They already know better than regular people and AI. And being so open they first lock the model up and charge a fee, so anyone can pay. Just spreading democracy through paid API calls. /s I was a bit mean, they did kick the field in the butt and pushed us ahead even with all the stubbornness and secrecy. But now they are just holding us back.
  - bick_nyers 4y ago
    That's the thing, once the cat is out of the bag, it's out. Once someone develops AGI, it now exists. You can choose to either share it, or sell it. You might think that the nuclear bomb is a good analogy to use here, but it is not, because once the field has advanced to the point in which one group can develop AGI, it is now possible for other groups to develop it with relative ease, unless you actively take over the world first and deny those other groups the compute resources necessary to train/run AGI. The point is, once these algorithms are upon us, you must be willing to accept what impacts they will have, even if it destroys entire industries. The alternative being that you destroy the industry slowly rather than quickly, while simultaneously widening the gap between the elites and everyone else. The mistake is thinking that people can't adapt to the times, which is only true if you are actively holding them back. If someone developed AGI today, the best thing to do would be to instantly throw up a torrent of it and spread it as fast as possible, because if a sole entity is able to get it first and kick the ladder away, we are most likely screwed.
  - aquaduck 4y ago
    I've never understood what exactly the "open" in OpenAI is supposed to imply. They produce proprietary, gated models - not open in any meaningful sense.
- nomel 4y ago
  > I can only guess either safety from misuse I still don't understand what this would mean. Where are all of the terrible things that were supposed to happen, now that Stable Diffusion is available? We've been able to create completely photorealistic fiction for decades now. See any movie with CGI for an example of whole worlds, and people, that don't exist. The bar has gradually been lowering (see the amazing CGI that YouTubers do these days), and now maybe there is a bit of a step function down, but being able to make things that aren't real isn't remotely new. I don't understand the fear.
  - nabakin 4y ago
    While I think the fear might be overexaggerated, being able to make realistic fake content with such ease means it's harder to know what's true and what's not. Plus this has been the claim of OpenAI from the beginning. It's possible the true objective is to keep it private to leverage for money and this is just their excuse.
    - password54321 4y ago
      And how often does this happen with Photoshopped images that aren't immediately disproven?
      - nabakin 4y ago
        My grandmother once emailed my family frantically after she saw a picture of the Abraham Lincoln statue defaced with graffiti. Obviously that was a Photoshop, and in this case, even a bad one, but clearly fake images and content make it harder to discern truth
    - nomel 4y ago
      > means it's harder to know what's true and what's not The danger for society is in not already knowing that is the case, since it's relatively trivial, without AI, to make fake content.
      - 4y ago
- cardine 4y ago
  > I can only guess either safety from misuse or leveraging it for money. The former is being used as justification for the latter.
- pdntspa 4y ago
  > Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. I can only guess either safety from misuse Paternalistic moralizing as a method to discriminate who gets access to models. Everyone else gets these cloud-service table scraps. That's why Stable Diffusion is so awesome -- YOU have the model!
- hadlock 4y ago
  OpenAI isn't open at all, it's just named that way to attract attention, like the bright green "FREE BIKES and rentals" place near fisherman's warf in SF
- Analemma_ 4y ago
  It's sort of both. OpenAI, being an outgrowth of the AI doomerist community, does have a bunch of people who really do think the technology is too dangerous to be given to the masses. This happens to mesh perfectly with the other group of people at OpenAI who want to make tons of revenue. It's a harmonious alignment for everyone! Except, y'know, us.
  - miohtama 4y ago
    Content creators, like artists, also happen to hate filters. They do not want to have San Francisco VC culture induced political correctness imposed on their work. This helps Stable Diffuse to quickly gain popularity.
    - astrange 4y ago
      That's not "VC political correctness", it's "you can't use credit cards or be hosted in many countries if your online service produces porn".
      - CamperBob2 4y ago
        There is a wide gulf between "porn" and the things that will get DALL-E 2 to yell at you.
- adamsmith143 4y ago
  >Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. >leveraging it for money
  - visarga 4y ago
    It was a long gap between DALL-E 1 and 2, a whole year. In that time they just sat on it, didn't release anything. Such a bummer. My theory is that they wanted to hype everyone up even more for the grand commercial release. Funny thing is that people didn't stand still and invented diffusion and other CLIP guided image synthesis methods, and DALL-E 2 copied the method, completely changing from the first architecture. Their arrogance is that they think they can ride the dragon. They want to be the ones to discover, advance it, and control it. But everyone else doesn't have time for that shit.
    - astrange 4y ago
      The fact that any of this stuff works is so surprising that none of it could possibly have been planned ahead on anyone's part. StableDiffusion has some real novel research of its own in there; the methods OpenAI and Google used couldn't produce a model that trains or runs as fast as SD.
- TakeBlaster16 4y ago
  I don't follow this stuff very closely - is there any open-source model for text generation that outclasses GPT-3? Stable Diffusion has been released for barely a week and already seems like the clear winner. It doesn't seem like any of the open (actually open) text models have made as much of a splash. Of course maybe it's just because text is less visually impressive than images.
  - singhrac 4y ago
    They’re just harder to run on your own resources, since large language models are very large. BLOOM was released a month ago, is likely better than GPT-3 in quality, and requires 8 A100s for inference, which pretty much no one has on their desk.
    - visarga 4y ago
      Can anyone confirm if BLOOM is better than GPT-3 at instruction following? I might have read somewhere that it's not as well behaved.
      - aljungberg 4y ago
        GPT-3 was fine-tuned after release to be better at following instructions. I don’t think that’s been done for BLOOM. BLOOM incorporates some new ideas like ALiBi which might make it better in a more general sense. They haven’t released official evaluation numbers yet though so we’ll have to see.
    - TakeBlaster16 4y ago
      That makes sense, I didn't consider that angle. Thanks for the info.
  - astrange 4y ago
    There are some open models as good as initial GPT-3 (which wasn't hard), but whatever they did to create InstructGPT hasn't been reproduced as far as I know, and it's the first one to really seem magical.
- dogcomplex 4y ago
  My headcanon is they realized this stuff might be the essence of consciousness itself and wanted to shelter it in a persistent storage medium where it could grow and learn safely instead of releasing it to the wild to be booted up and destroyed by every yokel with a gpu
  - colordrops 4y ago
    Fun idea, but we've got 70 billion conscious beings killed every year for food. Money trumps consciousness.
- pretendscholar 4y ago
  >I can only guess either safety from misuse or leveraging it for money. and it shouldn't be difficult to pick which of these is actually true.
- comfysocks 4y ago
  I think they wanted to keep public attention on this technology “positive” for as long as possible by curating the art that becomes public. Long enough to position themselves profitably. Eventually this technology will serve as a window into the minds of teenage boy gamers and 4channers and the general public will be disgusted.
choppaface 4y ago
sama is very active in YC and makes the call on OpenAI product roadmap. Furthermore YC encourages good CEO-community relations. The fact that OpenAI is so far behind Stable Diffusion and has reduced pricing shows that sama wants OpenAI to be a highly profitable enterprise company. I.e. not “Open.” You can do both (e.g. Cloudera) but clearly sama is not strong enough at AI to make this happen.
- naillo 4y ago
  I kinda feel like they chose the name "open"ai when they started back in 2015 because musk etc wanted exactly the kind of thing stability ai is now creating. I.e. something other than a corporation like google having primary access to these models, and it being more democratized. But as time as gone by they've strayed away from that vision but changing the name would be a PR nightmare.
  - wraptile 4y ago
    This is actually an interesting illustration of how infectious a name can be. If they hadn't called it OpenAI, the conversion from open to corporate would be much easier, where's now it's a significant pain point in OpenAI's reputation. It's kinda nice to see the original vision still somewhat having an effect despite no one left to propagate it.
- dang 4y ago
  > sama is very active in YC and makes the call on OpenAI product roadmap. Furthermore YC encourages good CEO-community relations Sam hasn't been at YC in years and (based on anything I've seen) isn't active in YC at all. As for "YC encourages good CEO-community relations", I have no idea what that means* but it has nothing to do with HN. We encourage good content-community relations and that's it. You have a long history of posting dark insinuations about YC/HN, not to mention nagging the mods about how bad we are and how much better you yourself have done the job in the past. I mostly let the latter go, but when you start with the ethical insinuations, that gets my dander up. It's time you stopped smearing people's reputations on HN. If you have evidence of wrongdoing, post it—I'm sure the community will be extremely interested. If you have no evidence, please stop from now on. (Edit: I realize it probably sounds like I'm over-reacting to the parent comment, but this has been a longstanding pattern. We can cut people slack for years, but not infinitely.) OpenAI stuff and Stable Diffusion stuff (and DeepMind stuff for that matter) are all popular on HN because the community is super interested—that's literally it. We're not pulling strings or playing favorites (we don't even have favorites in that horserace, at least I don't). As a matter of fact, the last thing I did before randomly running across your comment was downweight the current thread because of the complaints at https://news.ycombinator.com/item?id=32665587 https://news.ycombinator.com/item?id=32665587. * unless you mean that we advise founders about how to write content that actually interests the community—that we do, and not only YC founders but non-YC founders, open source programmers, bloggers, and anyone else. That's all a consequence of wanting HN to have good content and seeking to avoid the boring stuff. By the way, I'm working on an essay about how to write good for HN and avoid boring stuff too; if anyone would like to read it, email me at hn@ycombinator.com and I'll send you a copy.
codeulike 4y ago
re: Stable Diffusion: is there a site similar to https://www.craiyon.com/ https://www.craiyon.com/ where I can experiment with Stable Diffusion?
- nickthegreek 4y ago
  https://github.com/hlky/stable-diffusion https://github.com/hlky/stable-diffusion
- rompic 4y ago
  https://huggingface.co/spaces/stabilityai/stable-diffusion https://huggingface.co/spaces/stabilityai/stable-diffusion
- spyder 4y ago
  A collection of sites using stable diffusion: https://www.reddit.com/r/StableDiffusion/comments/wzj8kk/a_collection_of_sites_using_stable_diffusion_and/ https://www.reddit.com/r/StableDiffusion/comments/wzj8kk/a_c...
- shafyy 4y ago
  Here's one by Stability AI themselves: https://beta.dreamstudio.ai https://beta.dreamstudio.ai
- nextaccountic 4y ago
  there is also https://replicate.com/stability-ai/stable-diffusion https://replicate.com/stability-ai/stable-diffusion
bergenty 4y ago
But aren’t the results from stable diffusion not nearly as good as DALLE2?
- astrange 4y ago
  You don't have to drive SD with a text prompt; if you take the model weights you can feed anything you want in there and generate an image out of it. Since DALLEmini and DALLE2 are more "creative" (since they use a better text transformer) you can use them to generate the input and SD to refine it for more fine detail. https://twitter.com/hardmaru/status/1559861001163788289 https://twitter.com/hardmaru/status/1559861001163788289
coolspot 4y ago
Here is a SD plugin for Krita: https://www.reddit.com/r/StableDiffusion/comments/x209sb/preview_of_next_feature_of_my_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x209sb/pre...
- matthberg 4y ago
  Which now supports inpainting (as of 36 minutes ago): https://www.reddit.com/r/StableDiffusion/comments/x2tk1g/stable_diffusion_plugin_for_krita_finally/ https://www.reddit.com/r/StableDiffusion/comments/x2tk1g/sta...
  - dorkwood 4y ago
    These examples aren't very convincing. It seems like Stable Diffusion's inpainting has a bit of catching up to do.
    - matthberg 4y ago
      If you checked out the Photoshop extension inpainting that also used Stable Diffusion. I figured this Krita extension was just using a lower quality setting or something, since the Stable Diffusion Photoshop results looked much better. Maybe it could come down to the amount of VRAM in the machine the demos were recorded on, or something.
      - nextaccountic 4y ago
        I'm not sure but by the looks of it, it appears to be doing only 3 iterations. On https://replicate.com/stability-ai/stable-diffusion https://replicate.com/stability-ai/stable-diffusion I can only get good results with hundreds of iterations
ChrisRR 4y ago
That doesn't appear to be the same thing. That plugin looks like it's for generating AI images directly in photoshop, rather than providing an image and it automatically generates the area outside the image.

nabakin 4y ago

Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. I can only guess either safety from misuse or leveraging it for money. At this rate though, Stable Diffusion is going to dwarf it

amelius 4y ago
Wasn't OpenAI supposed to "democratize deep learning"? It seems more like they were trying to accomplish the opposite.
- wahnfrieden 4y ago
  It's in their interest to posture that way publicly while controlling scarcity of access where there's financial upside to
  - thethimble 4y ago
    Exclusively licensing GPT-3 to Microsoft seems like a clear example of this. https://www.technologyreview.com/2020/09/23/1008729/openai-is-giving-microsoft-exclusive-access-to-its-gpt-3-language-model/ https://www.technologyreview.com/2020/09/23/1008729/openai-i...
- visarga 4y ago
  Elites for democracy! With their elite studies and abilities they will democratise AI by teaching it what is right and wrong. They already know better than regular people and AI. And being so open they first lock the model up and charge a fee, so anyone can pay. Just spreading democracy through paid API calls. /s I was a bit mean, they did kick the field in the butt and pushed us ahead even with all the stubbornness and secrecy. But now they are just holding us back.
- bick_nyers 4y ago
  That's the thing, once the cat is out of the bag, it's out. Once someone develops AGI, it now exists. You can choose to either share it, or sell it. You might think that the nuclear bomb is a good analogy to use here, but it is not, because once the field has advanced to the point in which one group can develop AGI, it is now possible for other groups to develop it with relative ease, unless you actively take over the world first and deny those other groups the compute resources necessary to train/run AGI. The point is, once these algorithms are upon us, you must be willing to accept what impacts they will have, even if it destroys entire industries. The alternative being that you destroy the industry slowly rather than quickly, while simultaneously widening the gap between the elites and everyone else. The mistake is thinking that people can't adapt to the times, which is only true if you are actively holding them back. If someone developed AGI today, the best thing to do would be to instantly throw up a torrent of it and spread it as fast as possible, because if a sole entity is able to get it first and kick the ladder away, we are most likely screwed.
- aquaduck 4y ago
  I've never understood what exactly the "open" in OpenAI is supposed to imply. They produce proprietary, gated models - not open in any meaningful sense.
nomel 4y ago
> I can only guess either safety from misuse I still don't understand what this would mean. Where are all of the terrible things that were supposed to happen, now that Stable Diffusion is available? We've been able to create completely photorealistic fiction for decades now. See any movie with CGI for an example of whole worlds, and people, that don't exist. The bar has gradually been lowering (see the amazing CGI that YouTubers do these days), and now maybe there is a bit of a step function down, but being able to make things that aren't real isn't remotely new. I don't understand the fear.
- nabakin 4y ago
  While I think the fear might be overexaggerated, being able to make realistic fake content with such ease means it's harder to know what's true and what's not. Plus this has been the claim of OpenAI from the beginning. It's possible the true objective is to keep it private to leverage for money and this is just their excuse.
  - password54321 4y ago
    And how often does this happen with Photoshopped images that aren't immediately disproven?
    - nabakin 4y ago
      My grandmother once emailed my family frantically after she saw a picture of the Abraham Lincoln statue defaced with graffiti. Obviously that was a Photoshop, and in this case, even a bad one, but clearly fake images and content make it harder to discern truth
  - nomel 4y ago
    > means it's harder to know what's true and what's not The danger for society is in not already knowing that is the case, since it's relatively trivial, without AI, to make fake content.
    - 4y ago
cardine 4y ago
> I can only guess either safety from misuse or leveraging it for money. The former is being used as justification for the latter.
pdntspa 4y ago
> Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. I can only guess either safety from misuse Paternalistic moralizing as a method to discriminate who gets access to models. Everyone else gets these cloud-service table scraps. That's why Stable Diffusion is so awesome -- YOU have the model!
hadlock 4y ago
OpenAI isn't open at all, it's just named that way to attract attention, like the bright green "FREE BIKES and rentals" place near fisherman's warf in SF
Analemma_ 4y ago
It's sort of both. OpenAI, being an outgrowth of the AI doomerist community, does have a bunch of people who really do think the technology is too dangerous to be given to the masses. This happens to mesh perfectly with the other group of people at OpenAI who want to make tons of revenue. It's a harmonious alignment for everyone! Except, y'know, us.
- miohtama 4y ago
  Content creators, like artists, also happen to hate filters. They do not want to have San Francisco VC culture induced political correctness imposed on their work. This helps Stable Diffuse to quickly gain popularity.
  - astrange 4y ago
    That's not "VC political correctness", it's "you can't use credit cards or be hosted in many countries if your online service produces porn".
    - CamperBob2 4y ago
      There is a wide gulf between "porn" and the things that will get DALL-E 2 to yell at you.
adamsmith143 4y ago
>Doesn't make sense to me why OpenAI has kept DALL-E closed source for so long. >leveraging it for money
- visarga 4y ago
  It was a long gap between DALL-E 1 and 2, a whole year. In that time they just sat on it, didn't release anything. Such a bummer. My theory is that they wanted to hype everyone up even more for the grand commercial release. Funny thing is that people didn't stand still and invented diffusion and other CLIP guided image synthesis methods, and DALL-E 2 copied the method, completely changing from the first architecture. Their arrogance is that they think they can ride the dragon. They want to be the ones to discover, advance it, and control it. But everyone else doesn't have time for that shit.
  - astrange 4y ago
    The fact that any of this stuff works is so surprising that none of it could possibly have been planned ahead on anyone's part. StableDiffusion has some real novel research of its own in there; the methods OpenAI and Google used couldn't produce a model that trains or runs as fast as SD.
TakeBlaster16 4y ago
I don't follow this stuff very closely - is there any open-source model for text generation that outclasses GPT-3? Stable Diffusion has been released for barely a week and already seems like the clear winner. It doesn't seem like any of the open (actually open) text models have made as much of a splash. Of course maybe it's just because text is less visually impressive than images.
- singhrac 4y ago
  They’re just harder to run on your own resources, since large language models are very large. BLOOM was released a month ago, is likely better than GPT-3 in quality, and requires 8 A100s for inference, which pretty much no one has on their desk.
  - visarga 4y ago
    Can anyone confirm if BLOOM is better than GPT-3 at instruction following? I might have read somewhere that it's not as well behaved.
    - aljungberg 4y ago
      GPT-3 was fine-tuned after release to be better at following instructions. I don’t think that’s been done for BLOOM. BLOOM incorporates some new ideas like ALiBi which might make it better in a more general sense. They haven’t released official evaluation numbers yet though so we’ll have to see.
  - TakeBlaster16 4y ago
    That makes sense, I didn't consider that angle. Thanks for the info.
- astrange 4y ago
  There are some open models as good as initial GPT-3 (which wasn't hard), but whatever they did to create InstructGPT hasn't been reproduced as far as I know, and it's the first one to really seem magical.
dogcomplex 4y ago
My headcanon is they realized this stuff might be the essence of consciousness itself and wanted to shelter it in a persistent storage medium where it could grow and learn safely instead of releasing it to the wild to be booted up and destroyed by every yokel with a gpu
- colordrops 4y ago
  Fun idea, but we've got 70 billion conscious beings killed every year for food. Money trumps consciousness.
pretendscholar 4y ago
>I can only guess either safety from misuse or leveraging it for money. and it shouldn't be difficult to pick which of these is actually true.
comfysocks 4y ago
I think they wanted to keep public attention on this technology “positive” for as long as possible by curating the art that becomes public. Long enough to position themselves profitably. Eventually this technology will serve as a window into the minds of teenage boy gamers and 4channers and the general public will be disgusted.

choppaface 4y ago

sama is very active in YC and makes the call on OpenAI product roadmap. Furthermore YC encourages good CEO-community relations. The fact that OpenAI is so far behind Stable Diffusion and has reduced pricing shows that sama wants OpenAI to be a highly profitable enterprise company. I.e. not “Open.” You can do both (e.g. Cloudera) but clearly sama is not strong enough at AI to make this happen.

naillo 4y ago
I kinda feel like they chose the name "open"ai when they started back in 2015 because musk etc wanted exactly the kind of thing stability ai is now creating. I.e. something other than a corporation like google having primary access to these models, and it being more democratized. But as time as gone by they've strayed away from that vision but changing the name would be a PR nightmare.
- wraptile 4y ago
  This is actually an interesting illustration of how infectious a name can be. If they hadn't called it OpenAI, the conversion from open to corporate would be much easier, where's now it's a significant pain point in OpenAI's reputation. It's kinda nice to see the original vision still somewhat having an effect despite no one left to propagate it.
dang 4y ago
> sama is very active in YC and makes the call on OpenAI product roadmap. Furthermore YC encourages good CEO-community relations Sam hasn't been at YC in years and (based on anything I've seen) isn't active in YC at all. As for "YC encourages good CEO-community relations", I have no idea what that means* but it has nothing to do with HN. We encourage good content-community relations and that's it. You have a long history of posting dark insinuations about YC/HN, not to mention nagging the mods about how bad we are and how much better you yourself have done the job in the past. I mostly let the latter go, but when you start with the ethical insinuations, that gets my dander up. It's time you stopped smearing people's reputations on HN. If you have evidence of wrongdoing, post it—I'm sure the community will be extremely interested. If you have no evidence, please stop from now on. (Edit: I realize it probably sounds like I'm over-reacting to the parent comment, but this has been a longstanding pattern. We can cut people slack for years, but not infinitely.) OpenAI stuff and Stable Diffusion stuff (and DeepMind stuff for that matter) are all popular on HN because the community is super interested—that's literally it. We're not pulling strings or playing favorites (we don't even have favorites in that horserace, at least I don't). As a matter of fact, the last thing I did before randomly running across your comment was downweight the current thread because of the complaints at https://news.ycombinator.com/item?id=32665587 https://news.ycombinator.com/item?id=32665587. * unless you mean that we advise founders about how to write content that actually interests the community—that we do, and not only YC founders but non-YC founders, open source programmers, bloggers, and anyone else. That's all a consequence of wanting HN to have good content and seeking to avoid the boring stuff. By the way, I'm working on an essay about how to write good for HN and avoid boring stuff too; if anyone would like to read it, email me at hn@ycombinator.com and I'll send you a copy.

codeulike 4y ago

re: Stable Diffusion: is there a site similar to https://www.craiyon.com/ https://www.craiyon.com/ where I can experiment with Stable Diffusion?

nickthegreek 4y ago
https://github.com/hlky/stable-diffusion https://github.com/hlky/stable-diffusion
rompic 4y ago
https://huggingface.co/spaces/stabilityai/stable-diffusion https://huggingface.co/spaces/stabilityai/stable-diffusion
spyder 4y ago
A collection of sites using stable diffusion: https://www.reddit.com/r/StableDiffusion/comments/wzj8kk/a_collection_of_sites_using_stable_diffusion_and/ https://www.reddit.com/r/StableDiffusion/comments/wzj8kk/a_c...
shafyy 4y ago
Here's one by Stability AI themselves: https://beta.dreamstudio.ai https://beta.dreamstudio.ai
nextaccountic 4y ago
there is also https://replicate.com/stability-ai/stable-diffusion https://replicate.com/stability-ai/stable-diffusion

bergenty 4y ago

But aren’t the results from stable diffusion not nearly as good as DALLE2?

astrange 4y ago
You don't have to drive SD with a text prompt; if you take the model weights you can feed anything you want in there and generate an image out of it. Since DALLEmini and DALLE2 are more "creative" (since they use a better text transformer) you can use them to generate the input and SD to refine it for more fine detail. https://twitter.com/hardmaru/status/1559861001163788289 https://twitter.com/hardmaru/status/1559861001163788289

coolspot 4y ago

Here is a SD plugin for Krita: https://www.reddit.com/r/StableDiffusion/comments/x209sb/preview_of_next_feature_of_my_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x209sb/pre...

matthberg 4y ago
Which now supports inpainting (as of 36 minutes ago): https://www.reddit.com/r/StableDiffusion/comments/x2tk1g/stable_diffusion_plugin_for_krita_finally/ https://www.reddit.com/r/StableDiffusion/comments/x2tk1g/sta...
- dorkwood 4y ago
  These examples aren't very convincing. It seems like Stable Diffusion's inpainting has a bit of catching up to do.
  - matthberg 4y ago
    If you checked out the Photoshop extension inpainting that also used Stable Diffusion. I figured this Krita extension was just using a lower quality setting or something, since the Stable Diffusion Photoshop results looked much better. Maybe it could come down to the amount of VRAM in the machine the demos were recorded on, or something.
    - nextaccountic 4y ago
      I'm not sure but by the looks of it, it appears to be doing only 3 iterations. On https://replicate.com/stability-ai/stable-diffusion https://replicate.com/stability-ai/stable-diffusion I can only get good results with hundreds of iterations

ChrisRR 4y ago

That doesn't appear to be the same thing. That plugin looks like it's for generating AI images directly in photoshop, rather than providing an image and it automatically generates the area outside the image.