6 ms·

Congrats on the release! I gave this and other available applications a try and I don’t understand what people see in ai image generation. A simple prompt gen

by dt3ft 4y ago

Congrats on the release! I gave this and other available applications a try and I don’t understand what people see in ai image generation. A simple prompt generated a person with 3 nostrils, 7 squished fingers, deformities everywhere I look, it just mashes a bunch of photographs together and generates abominations. Pay close attention to generated models and you will find details which are simply wrong. What is the use case that I’m missing?

stefandesu 4y ago
I haven't been able to get any good results with Stable Diffusion (via DiffusionBee on my M1 MacBook Air), but I've seen really good images of other AI generators like Midjourney.
nelsondev 4y ago
Play around with other prompts. For example, “golden gate bridge in the style of Van Gogh futuristic”. Architecture is cool. It doesn’t do people well
tomcam 4y ago
> and generates abominations You make it sound like that’s a bad thing
- dt3ft 4y ago
  Horror movie material for sure :) Who knows, maybe this inspires better horror movie creatures :)
frankzander 4y ago
Nothing. It's IMHO just a hype of the younger nerdy generation. The real world applications of NN-based (there is no I in A) image generation are limited. One hype comes the other hype goes. IMHO it did not come to stay ;-)
- gpderetta 4y ago
  As a 40ish year old, the future shock from all these AI image generators is extreme. This stuff was literally science fiction just a couple of years ago. Now you run it in your phone.
pdntspa 4y ago
try some of the prompts listed on lexica.art. Stable Diffusion needs good prompt engineering to turn out well
dave_sullivan 4y ago
It's more of a cool technology that is rapidly advancing. A couple years ago, it couldn't do this much. A couple years from now, it will be much better. It does much more than mash images together, which you would know if you dug into it a bit. That's it, that's the whole thing.
cdrini 4y ago
I can't speak for others, but I've personally been quite impressed by the dalle output. It creates things that would take me hours (if not days) to create, which no other tech I've tried has been able to generate. It feels like it can absolutely replace at least the stock photo industry. It's also terrific for things like blog photos if you don't have the time or talent to create something yourself, but want some creative control. Expansions like dream booth, which let you fine tune the system with your own submitted images are also quite amazing. Being able to give it just a few photos, and say things like "show me surfing in the ocean" and get a reasonable image back. _Much_ more broadly, this space in AI/ML with GPT3/Dalle is exciting because it feels kind of like what the internet was made for. There's too much data on the internet for any one person to ever meaningfully process. But a machine can. And you can ask that machine questions. And instead of getting just a list of references back, you get an "answer". Image generation is the "image answer" part of this system. It's an exciting space because it feels like these systems will affect large chunks of how we use computers. Here's a cool GPT3 "programming" example: https://twitter.com/goodside/status/1581805503897735168 https://twitter.com/goodside/status/1581805503897735168 And here are some of my dalle uses I've been impressed by, that I feel is publish-ready: - https://labs.openai.com/s/nkOTLRWzjgQTe4QsgoWChP7n https://labs.openai.com/s/nkOTLRWzjgQTe4QsgoWChP7n - https://labs.openai.com/s/uSP55qRf1SqCbYTa2UDXXEfA https://labs.openai.com/s/uSP55qRf1SqCbYTa2UDXXEfA - https://labs.openai.com/s/kO2purvEodK5UUxPIpL78bQh https://labs.openai.com/s/kO2purvEodK5UUxPIpL78bQh - https://labs.openai.com/s/2P1Mb75JbS1mmpyi86xwyyUg https://labs.openai.com/s/2P1Mb75JbS1mmpyi86xwyyUg
- dt3ft 4y ago
  Thanks, this was helpful to better understand the use cases.
grumbel 4y ago
The 3 nostrils, 7 squished fingers are not that big of a problem, you can run other image enhancing AIs on top of the generated images to fix that, or just use inpainting and give it a few more tries to get it right. The models are also slowly getting better at it. > What is the use case that I’m missing? It's generating images from nothing more than a text description, a year ago that was something you'd only saw an StarTrek. Now it's real and we have barely scratched the surface of what is possible. The images still need some manual work, but try to generate images of that quality and complexity by hand and you might have more appreciation how mindblowing it is that AI can not only do it, but do it in seconds.
pmarreck 4y ago
There needs to be some sort of piece or filter that understands body geometries and inverse kinematics to prevent things like generating people with 3 limbs or joints in positions that would not normally be feasible without injury =). It'll come.
fragmede 4y ago
Early cars were terrible too, but here we are. The promise is that future versions of the technology will be able to draw anatomically correct people and images. A computer program that can do in mere minutes what takes a person hours. If you've never wanted a picture of something you can describe but aren't able to draw in your life, then there is no use case for you. For anyone else that's interacted with the world of art and graphic designers or used stock photos; this goes an order of magnitude faster, and is basically free, compared to hiring a skilled professional for hours. It's a game changer for an industry that it sounds like you've just never interacted with.
- fock 4y ago
  > Early cars were terrible too, but here we are. Were they? https://en.wikipedia.org/wiki/Benz_Patent-Motorwagen https://en.wikipedia.org/wiki/Benz_Patent-Motorwagen - as fast as a carriage, about the same stink. Carriages clearly had a usecase. Generated images now: take enormous energy to generate. Main current usecase is to gobble up more energy (mass media/entertainment).
  - toqy 4y ago
    And images have a clear use case. Stable Diffusion is effectively moving the horse under the hood.
  - fragmede 4y ago
    They were. They were loud and stinky and were unsuitable for dirt roads, spooking horses, causing the UK to basically ban them. Some were powered by steam or coal but those that were powered by gas had a different problem - there were no gas stations. You had to hand crank them to start. Moving goods and people around was already a solved problem with horses and trains and boats. Cars then: take enormous energy to move very little, and slowly. Main use case then was as a rich person's toy (entertainment). They'll never replace work horses with them. It's easy, in hindsight, to see cars as inevitable. But you had to see past the shortcomings of the earliest cars to "get it", much like you have to see past the 3 armed monstrosities that current image generation techniques produce and see the promise of the technology. There were undoubtedly those who saw cars as hype, much like image generation is seen today; I'm sure buggy whip manufacturers saw cars as hype and refused to get on what looked like a hype train to them.
saberience 4y ago
Already on some of the homegrown models (https://rentry.co/sdmodels https://rentry.co/sdmodels) these things are fixed already. For the Stable Diffusion "enthusiasts" the tools and models have improved at least 100% since the original release.
gpderetta 4y ago
It does require a lot of cherry picking and fine tuning to get anything good, and yes, SD is terrible, terrible at hands. It is still extremely impressive and is improving every day.
juliendorra 4y ago
The use cases that are being explored now are: Movie preparation, storytelling https://twitter.com/juliendorra/status/1590058518174134272 https://twitter.com/juliendorra/status/1590058518174134272 https://twitter.com/mrjonfinger/status/1590021753979670528 https://twitter.com/mrjonfinger/status/1590021753979670528 Fan art! https://twitter.com/rainisto/status/1581169461167816704 https://twitter.com/rainisto/status/1581169461167816704 https://twitter.com/rainisto/status/1579474636202708993 https://twitter.com/rainisto/status/1579474636202708993 Product shots and generative marketing https://twitter.com/dtcforeverr/status/1589916644939161600 https://twitter.com/dtcforeverr/status/1589916644939161600 https://twitter.com/kylebrussell/status/1590563734317338624 https://twitter.com/kylebrussell/status/1590563734317338624 2D game assets, character design https://twitter.com/emmanuel_2m/status/1588249026272448512 https://twitter.com/emmanuel_2m/status/1588249026272448512 https://twitter.com/elsableda/status/1562465392563351552 https://twitter.com/elsableda/status/1562465392563351552 Imaginary selfies (self-portrait is a huge human use case!) https://twitter.com/stevenpargett/status/1590047241183821824 https://twitter.com/stevenpargett/status/1590047241183821824 https://twitter.com/dh7net/status/1581298913637646336 https://twitter.com/dh7net/status/1581298913637646336 https://twitter.com/fabianstelzer/status/1579818105672302592 https://twitter.com/fabianstelzer/status/1579818105672302592 Styling by example https://twitter.com/norod78/status/1590056501544386560 https://twitter.com/norod78/status/1590056501544386560 Raw sketch to final image https://twitter.com/nousr_/status/1564797121412210688 https://twitter.com/nousr_/status/1564797121412210688 Editing in the most generic sense (replacing part of an image) https://twitter.com/bigblueboo/status/1585761916718383110 https://twitter.com/bigblueboo/status/1585761916718383110
scrumlord 4y ago
You're missing imagination and the ability to write a good prompt. Come back when you're smarter.

by dt3ft 4y ago

stefandesu 4y ago

I haven't been able to get any good results with Stable Diffusion (via DiffusionBee on my M1 MacBook Air), but I've seen really good images of other AI generators like Midjourney.

nelsondev 4y ago

Play around with other prompts. For example, “golden gate bridge in the style of Van Gogh futuristic”. Architecture is cool. It doesn’t do people well

tomcam 4y ago

> and generates abominations You make it sound like that’s a bad thing

dt3ft 4y ago
Horror movie material for sure :) Who knows, maybe this inspires better horror movie creatures :)

frankzander 4y ago

Nothing. It's IMHO just a hype of the younger nerdy generation. The real world applications of NN-based (there is no I in A) image generation are limited. One hype comes the other hype goes. IMHO it did not come to stay ;-)

gpderetta 4y ago
As a 40ish year old, the future shock from all these AI image generators is extreme. This stuff was literally science fiction just a couple of years ago. Now you run it in your phone.

pdntspa 4y ago

try some of the prompts listed on lexica.art. Stable Diffusion needs good prompt engineering to turn out well

dave_sullivan 4y ago

It's more of a cool technology that is rapidly advancing. A couple years ago, it couldn't do this much. A couple years from now, it will be much better. It does much more than mash images together, which you would know if you dug into it a bit. That's it, that's the whole thing.

cdrini 4y ago

I can't speak for others, but I've personally been quite impressed by the dalle output. It creates things that would take me hours (if not days) to create, which no other tech I've tried has been able to generate. It feels like it can absolutely replace at least the stock photo industry. It's also terrific for things like blog photos if you don't have the time or talent to create something yourself, but want some creative control. Expansions like dream booth, which let you fine tune the system with your own submitted images are also quite amazing. Being able to give it just a few photos, and say things like "show me surfing in the ocean" and get a reasonable image back. _Much_ more broadly, this space in AI/ML with GPT3/Dalle is exciting because it feels kind of like what the internet was made for. There's too much data on the internet for any one person to ever meaningfully process. But a machine can. And you can ask that machine questions. And instead of getting just a list of references back, you get an "answer". Image generation is the "image answer" part of this system. It's an exciting space because it feels like these systems will affect large chunks of how we use computers. Here's a cool GPT3 "programming" example: https://twitter.com/goodside/status/1581805503897735168 https://twitter.com/goodside/status/1581805503897735168 And here are some of my dalle uses I've been impressed by, that I feel is publish-ready: - https://labs.openai.com/s/nkOTLRWzjgQTe4QsgoWChP7n https://labs.openai.com/s/nkOTLRWzjgQTe4QsgoWChP7n - https://labs.openai.com/s/uSP55qRf1SqCbYTa2UDXXEfA https://labs.openai.com/s/uSP55qRf1SqCbYTa2UDXXEfA - https://labs.openai.com/s/kO2purvEodK5UUxPIpL78bQh https://labs.openai.com/s/kO2purvEodK5UUxPIpL78bQh - https://labs.openai.com/s/2P1Mb75JbS1mmpyi86xwyyUg https://labs.openai.com/s/2P1Mb75JbS1mmpyi86xwyyUg

dt3ft 4y ago
Thanks, this was helpful to better understand the use cases.

grumbel 4y ago

The 3 nostrils, 7 squished fingers are not that big of a problem, you can run other image enhancing AIs on top of the generated images to fix that, or just use inpainting and give it a few more tries to get it right. The models are also slowly getting better at it. > What is the use case that I’m missing? It's generating images from nothing more than a text description, a year ago that was something you'd only saw an StarTrek. Now it's real and we have barely scratched the surface of what is possible. The images still need some manual work, but try to generate images of that quality and complexity by hand and you might have more appreciation how mindblowing it is that AI can not only do it, but do it in seconds.

pmarreck 4y ago

There needs to be some sort of piece or filter that understands body geometries and inverse kinematics to prevent things like generating people with 3 limbs or joints in positions that would not normally be feasible without injury =). It'll come.

fragmede 4y ago

Early cars were terrible too, but here we are. The promise is that future versions of the technology will be able to draw anatomically correct people and images. A computer program that can do in mere minutes what takes a person hours. If you've never wanted a picture of something you can describe but aren't able to draw in your life, then there is no use case for you. For anyone else that's interacted with the world of art and graphic designers or used stock photos; this goes an order of magnitude faster, and is basically free, compared to hiring a skilled professional for hours. It's a game changer for an industry that it sounds like you've just never interacted with.

fock 4y ago
> Early cars were terrible too, but here we are. Were they? https://en.wikipedia.org/wiki/Benz_Patent-Motorwagen https://en.wikipedia.org/wiki/Benz_Patent-Motorwagen - as fast as a carriage, about the same stink. Carriages clearly had a usecase. Generated images now: take enormous energy to generate. Main current usecase is to gobble up more energy (mass media/entertainment).
- toqy 4y ago
  And images have a clear use case. Stable Diffusion is effectively moving the horse under the hood.
- fragmede 4y ago
  They were. They were loud and stinky and were unsuitable for dirt roads, spooking horses, causing the UK to basically ban them. Some were powered by steam or coal but those that were powered by gas had a different problem - there were no gas stations. You had to hand crank them to start. Moving goods and people around was already a solved problem with horses and trains and boats. Cars then: take enormous energy to move very little, and slowly. Main use case then was as a rich person's toy (entertainment). They'll never replace work horses with them. It's easy, in hindsight, to see cars as inevitable. But you had to see past the shortcomings of the earliest cars to "get it", much like you have to see past the 3 armed monstrosities that current image generation techniques produce and see the promise of the technology. There were undoubtedly those who saw cars as hype, much like image generation is seen today; I'm sure buggy whip manufacturers saw cars as hype and refused to get on what looked like a hype train to them.

saberience 4y ago

Already on some of the homegrown models (https://rentry.co/sdmodels https://rentry.co/sdmodels) these things are fixed already. For the Stable Diffusion "enthusiasts" the tools and models have improved at least 100% since the original release.

gpderetta 4y ago

It does require a lot of cherry picking and fine tuning to get anything good, and yes, SD is terrible, terrible at hands. It is still extremely impressive and is improving every day.

juliendorra 4y ago

The use cases that are being explored now are: Movie preparation, storytelling https://twitter.com/juliendorra/status/1590058518174134272 https://twitter.com/juliendorra/status/1590058518174134272 https://twitter.com/mrjonfinger/status/1590021753979670528 https://twitter.com/mrjonfinger/status/1590021753979670528 Fan art! https://twitter.com/rainisto/status/1581169461167816704 https://twitter.com/rainisto/status/1581169461167816704 https://twitter.com/rainisto/status/1579474636202708993 https://twitter.com/rainisto/status/1579474636202708993 Product shots and generative marketing https://twitter.com/dtcforeverr/status/1589916644939161600 https://twitter.com/dtcforeverr/status/1589916644939161600 https://twitter.com/kylebrussell/status/1590563734317338624 https://twitter.com/kylebrussell/status/1590563734317338624 2D game assets, character design https://twitter.com/emmanuel_2m/status/1588249026272448512 https://twitter.com/emmanuel_2m/status/1588249026272448512 https://twitter.com/elsableda/status/1562465392563351552 https://twitter.com/elsableda/status/1562465392563351552 Imaginary selfies (self-portrait is a huge human use case!) https://twitter.com/stevenpargett/status/1590047241183821824 https://twitter.com/stevenpargett/status/1590047241183821824 https://twitter.com/dh7net/status/1581298913637646336 https://twitter.com/dh7net/status/1581298913637646336 https://twitter.com/fabianstelzer/status/1579818105672302592 https://twitter.com/fabianstelzer/status/1579818105672302592 Styling by example https://twitter.com/norod78/status/1590056501544386560 https://twitter.com/norod78/status/1590056501544386560 Raw sketch to final image https://twitter.com/nousr_/status/1564797121412210688 https://twitter.com/nousr_/status/1564797121412210688 Editing in the most generic sense (replacing part of an image) https://twitter.com/bigblueboo/status/1585761916718383110 https://twitter.com/bigblueboo/status/1585761916718383110

scrumlord 4y ago

You're missing imagination and the ability to write a good prompt. Come back when you're smarter.