5 ms·

But it didn't drop the bar on the ground, it raised a new bar. People without computer literacy and/or basic programming skills won't be able to pull this off.

But it didn't drop the bar on the ground, it raised a new bar. People without computer literacy and/or basic programming skills won't be able to pull this off. Even using Photoshop (which I believe does/will integrate this new technology) is not easy/possible for some who can actually draw. Plus, how many regular people have access to the machine with 12GB of VRAM?

coding123 4y ago
It dropped the bar to the other side of the planet. There are so many people computer literate that can pull this off. You could pick 5 people off the street that can follow these instructions and 3 of them would. VS the old way, you would have to pull off 400 people off the street and you probably wouldn't get this result unless you got really lucky.
- ipaddr 4y ago
  Pick 5 people at random you get one who doesn't know what a mouse is, 2 or 3 who can turn on the computer and maybe one who can get to the cli. Out of 400 people you will find more natural artists compared to someone who could install this even if they had the equipment
  - visarga 4y ago
    They can use it from their phone or tablet.
  - bee_rider 4y ago
    There are already web sites that will run the underlying models, requiring no installation. The neat new applications that have taken over this site for the last couple days sometimes require CLI steps to install because they are in active development and it can be easier to experiment with something local. I'm sure they'll either be moved online or wrapped in nice installers over the next couple weeks.
  - dougmwne 4y ago
    Let me update your heuristics on this. Computer mice are practically obsolete. People use cell phones, not computers. No one needs a cli to run stable diffusion because a mobile web interface was released on day one. 6.6 billion people have a smartphone which is 83% of the world’s population (including the infants). This is about the same number of people who are literate. 4 out of 5 people globally would be able to submit a stable diffusion prompt and view a result. Most would have no idea what the hell was going on or even why it was interesting.
    - kaibee 4y ago
      > Most would have no idea what the hell was going on or even why it was interesting. This is the funniest part to me, because so many people already think this is how digital art worked to begin with.
josephwegner 4y ago
The parts that are inaccessible right now seem incredibly easy to overcome. Using a CLI-based tool is inaccessible for most people... but building a GUI around this would be very easy. I'm too lazy to google it, but I would bet someone already has a GUI, or is working on one. 12GB of VRAM may not be accessible on most computers, but there's nothing innovative about offloading that task to an EC2 instance. It just requires an opportunistic developer to tie the pieces together. I would be monumentally surprised if Figma/Canva/InVision/Adobe are not already working on this.
- vkou 4y ago
  > Using a CLI-based tool is inaccessible for most people... CLI-based tools are perfectly accessible to most people. They just can't be arsed to learn them, unless they need to. And most of the time, they don't, because good-enough alternatives exist. If a CLI-based tool is the only way that an average person can get their work done, that's what they'll use.
- fragmede 4y ago
  If you're on windows and have a GPU, there's a GUI you can install. https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_easytoinstall_windows_gui_for_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_... There's a WebUI with a docker container if you're on Linux w/ GPU; https://github.com/AbdBarho/stable-diffusion-webui https://github.com/AbdBarho/stable-diffusion-webui and https://github.com/AbdBarho/stable-diffusion-webui-docker https://github.com/AbdBarho/stable-diffusion-webui-docker. If you don't have a GPU, there's a Colab UI (Google hosted GPU). https://github.com/pinilpypinilpy/sd-webui-colab-simplified https://github.com/pinilpypinilpy/sd-webui-colab-simplified
hbn 4y ago
The method shown in this demo was already simple enough to teach someone to do in an afternoon. But we're only a week into the release of SD and we haven't gotten to all the sure-to-come GUIs that will pack the model into an idiot-proof application. Think about it, give the user a few basic, MS-Paint level pencil tools, colors, shape makers. Ask for a description, the application can even push you in the right direction for putting together good, detailed prompts, gives you a list of art-styles, artists, filtering methods, etc all with reference images so you don't need to memorize names. You can zoom into sections of the image to work on independently (like the birds in the article), then blend it into the greater image. Drag and drop image files onto the project and iterate on them. Implementing the glue to simplify the "tough" parts of this process is honestly pretty trivial.
ridgered4 4y ago
> Plus, how many regular people have access to the machine with 12GB of VRAM? Probably not many in general, but the RTX 3060 has 12GB or ram and it is around $350. And I saw a RTX 2060 12GB for $250 the other day. That's a pretty reasonable entry fee IMO.
- bawolff 4y ago
  Much less than what photoshop costed back in the day.
mtizim 4y ago
You can run the model on your CPU quite easily, and a lot of people have access to 16gb machines - it's much slower, for sure (10minutes/50passes on my old gaming pc), but it's still much faster than drawing things of the same quality by hand.
nanonomad 4y ago
Few have those high end cards, but they don't need to anymore. Huggingface is saying it needs 12gb, but the source was forked with some smart mods to chunk the loading on to the GPU. Itll comfortably run on 6gb now. gtx1600 series cards need to run in full precision mode to produce output. The HLKY fork has improved the Gradio GUI and integrated realesrgan and gfpgan for those with beefier cards. Someone else also figured out how to load and run it all on a CPU, so pretty much anyone can in theory run the model now. There is an elaborate Colab notebook linked in the HLKY repo that seems to get more point and click user friendly every time i look at it. I think it even launches the gradio webui so you can use the Colab instance with a webui remotely.
physicsguy 4y ago
> People without computer literacy and/or basic programming skills won't be able to pull this off. Yet. This is a huge leap forward, to get more basic prompts generating things will be a much smaller leap IMO.

coding123 4y ago

It dropped the bar to the other side of the planet. There are so many people computer literate that can pull this off. You could pick 5 people off the street that can follow these instructions and 3 of them would. VS the old way, you would have to pull off 400 people off the street and you probably wouldn't get this result unless you got really lucky.

ipaddr 4y ago
Pick 5 people at random you get one who doesn't know what a mouse is, 2 or 3 who can turn on the computer and maybe one who can get to the cli. Out of 400 people you will find more natural artists compared to someone who could install this even if they had the equipment
- visarga 4y ago
  They can use it from their phone or tablet.
- bee_rider 4y ago
  There are already web sites that will run the underlying models, requiring no installation. The neat new applications that have taken over this site for the last couple days sometimes require CLI steps to install because they are in active development and it can be easier to experiment with something local. I'm sure they'll either be moved online or wrapped in nice installers over the next couple weeks.
- dougmwne 4y ago
  Let me update your heuristics on this. Computer mice are practically obsolete. People use cell phones, not computers. No one needs a cli to run stable diffusion because a mobile web interface was released on day one. 6.6 billion people have a smartphone which is 83% of the world’s population (including the infants). This is about the same number of people who are literate. 4 out of 5 people globally would be able to submit a stable diffusion prompt and view a result. Most would have no idea what the hell was going on or even why it was interesting.
  - kaibee 4y ago
    > Most would have no idea what the hell was going on or even why it was interesting. This is the funniest part to me, because so many people already think this is how digital art worked to begin with.

josephwegner 4y ago

The parts that are inaccessible right now seem incredibly easy to overcome. Using a CLI-based tool is inaccessible for most people... but building a GUI around this would be very easy. I'm too lazy to google it, but I would bet someone already has a GUI, or is working on one. 12GB of VRAM may not be accessible on most computers, but there's nothing innovative about offloading that task to an EC2 instance. It just requires an opportunistic developer to tie the pieces together. I would be monumentally surprised if Figma/Canva/InVision/Adobe are not already working on this.

vkou 4y ago
> Using a CLI-based tool is inaccessible for most people... CLI-based tools are perfectly accessible to most people. They just can't be arsed to learn them, unless they need to. And most of the time, they don't, because good-enough alternatives exist. If a CLI-based tool is the only way that an average person can get their work done, that's what they'll use.
fragmede 4y ago
If you're on windows and have a GPU, there's a GUI you can install. https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_easytoinstall_windows_gui_for_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x1hp4u/my_... There's a WebUI with a docker container if you're on Linux w/ GPU; https://github.com/AbdBarho/stable-diffusion-webui https://github.com/AbdBarho/stable-diffusion-webui and https://github.com/AbdBarho/stable-diffusion-webui-docker https://github.com/AbdBarho/stable-diffusion-webui-docker. If you don't have a GPU, there's a Colab UI (Google hosted GPU). https://github.com/pinilpypinilpy/sd-webui-colab-simplified https://github.com/pinilpypinilpy/sd-webui-colab-simplified

hbn 4y ago

The method shown in this demo was already simple enough to teach someone to do in an afternoon. But we're only a week into the release of SD and we haven't gotten to all the sure-to-come GUIs that will pack the model into an idiot-proof application. Think about it, give the user a few basic, MS-Paint level pencil tools, colors, shape makers. Ask for a description, the application can even push you in the right direction for putting together good, detailed prompts, gives you a list of art-styles, artists, filtering methods, etc all with reference images so you don't need to memorize names. You can zoom into sections of the image to work on independently (like the birds in the article), then blend it into the greater image. Drag and drop image files onto the project and iterate on them. Implementing the glue to simplify the "tough" parts of this process is honestly pretty trivial.

ridgered4 4y ago

> Plus, how many regular people have access to the machine with 12GB of VRAM? Probably not many in general, but the RTX 3060 has 12GB or ram and it is around $350. And I saw a RTX 2060 12GB for $250 the other day. That's a pretty reasonable entry fee IMO.

bawolff 4y ago
Much less than what photoshop costed back in the day.

mtizim 4y ago

You can run the model on your CPU quite easily, and a lot of people have access to 16gb machines - it's much slower, for sure (10minutes/50passes on my old gaming pc), but it's still much faster than drawing things of the same quality by hand.

nanonomad 4y ago

Few have those high end cards, but they don't need to anymore. Huggingface is saying it needs 12gb, but the source was forked with some smart mods to chunk the loading on to the GPU. Itll comfortably run on 6gb now. gtx1600 series cards need to run in full precision mode to produce output. The HLKY fork has improved the Gradio GUI and integrated realesrgan and gfpgan for those with beefier cards. Someone else also figured out how to load and run it all on a CPU, so pretty much anyone can in theory run the model now. There is an elaborate Colab notebook linked in the HLKY repo that seems to get more point and click user friendly every time i look at it. I think it even launches the gradio webui so you can use the Colab instance with a webui remotely.

physicsguy 4y ago

> People without computer literacy and/or basic programming skills won't be able to pull this off. Yet. This is a huge leap forward, to get more basic prompts generating things will be a much smaller leap IMO.