37 ms·
Stable Diffusion is a big deal
- klztag 4y agoWhat we are currently seeing are absurd pictures devoid of any meaning. It has nothing to do with art and purpose. But bloggers who are surprisingly often on the side of the current mainstream apparently think different --- for now.
- thot_experiment 4y agoMaybe this current explosion in the relevance and visibility of this kind of AI model will finally lead us to rethink how insanely nonsensical our IP systems are. I'm not holding my breath, but there's hope that this sort of thing will (combined with situations like the HBO debacle) clarify the need for massive IP reform in the cultural zeitgeist. The problem here isn't that the model was trained on copyrighted works, the problem is copyright itself and a cultural focus on collecting rent. We probably need UBI or equivalent to deal with the outcomes here in a healthy way.
- LewisVerstappen 4y agoWhy do people keep bringing up copyright anyway? It seems pretty clear that the images being generated by StableDiffusion are transformative so it's protected under Fair Use. Am I missing something here?
- imgabe 4y agoFair use is a defense. You can still be sued for fair use, you have to go to court and prove to a judge or jury that your work constitutes fair use.
- LewisVerstappen 4y agoYes but we have a common law system and there's already tons of precedent that training AI systems is transformative. It's also quite obvious just by looking at the generated images that it's clearly transformative. The images generated are unique and you can't trace the original copyrighted image from what's generated. You really don't need a judge to see that Fair Use covers Stable Diffusion.
- Natsu 4y agoYou can beat the rap but you can't beat the ride. Federal lawsuits are not cheap and the default is that you pay your own costs, you have to win the argument that you should get court costs & attorney's fees.
- rhdunn 4y agoWhat happens if you give an image prompt like "mona lisa", "daffodils van gogh", or similar designed to describe an image the model was trained on. Will it generate that image? Or for written works, start with a sentance from a copyrighted work, or part of licensed code. Will it start reproducing that work word for word (like code pilot can do with the GPL license)? Getting these to generate copies of GPL'd, company owned, or other code with restrictions can lead to complex issues for the person/company using that code. Or likewise if a story contains significant elements of copyrighted works; worse if the works have trademarked elements.
- slyall 4y agoWhat do you picture when you see words like "Elvis Presley" , "Game of Thrones" or "The Google logo"? Explain how you are not a copyright violating machine.
- sarchertech 4y agoI absolutely would be if I took copyrighted images out of my head and distributed them.
- criddell 4y ago> The images generated are unique and you can't trace the original copyrighted image from what's generated. That might not always be true. I've gotten some results back that had the Getty watermark on them and others with the artist's signature. Unless the AI is adding that to images that never had one before (which might be a trademark issue), then you might be able to determine the provenance of the image components. Is there something equivalent to the yellow dots printers add to their output that would survive the AI transformation?
- PeterisP 4y agoWell, you can still be sued even if the reason is almost totally bogus, and you have to go to court and make a stand that the reason is bogus. Doing only 100% legal things won't protect you from being sued.
- throwaway1851 4y agoThere are really significant, novel copyright issues implicated by these large generative models trained on other people’s IP. If you take a step back, you can see that there are different ways to frame what is happening. One frame is: “Defendant built an algorithm that memorized features of Plaintiff’s IP. Defendant’s algorithm recombines parts of those features in order to produce works in the same domain that compete with Plaintiff’s work, all without Plaintiff’s consent.” Bear in mind that copyright holders are among the most litigious out there. If generative art becomes as big a deal as some people expect, they will have every incentive to use their huge litigation budgets to claim a piece of the action. Because the law develops very slowly, the legal process has not yet had the occasion to really evaluate what transformative use means in this novel context. I’m personally interested in seeing where things go, but it’s going to be a while before we know where the law is headed.
- klipt 4y ago> “Defendant built an algorithm that memorized features of Plaintiff’s IP. Defendant’s algorithm recombines parts of those features in order to produce works in the same domain that compete with Plaintiff’s work, all without Plaintiff’s consent.” The fun part is, this is how human artists learn too.
- throwaway1851 4y agoThey absolutely do. What they don’t do is mechanistically clone compressed mathematical representations of input data. The human part of the creative process could very well be a distinguishing feature, legally.
- nilsbunger 4y agoIt will be hard to tell whether an image was created by a “human creative process” or AI. Will the same image be legal if a human made it but not if it was created by Stable Diffusion? How will someone even know, short of a legal discovery process?
- Toadtoad 4y agoWhether a work is transformative or not isn't the only factor that goes towards a fair use ruling. Bring transformative is just a part of the "purpose and character of use", which is a single factor weighed alongside the nature of the original work, the amount and substance used (if the "heart of the work" was copied), and the effect the derivative has on the market for the original work. It's much more complicated here, and will have to be ruled on a case-by-case basis, as far as I know, and copyright holders could potentially make many cases using the other factors that a use isn't fair. I do think it should be considered fair use, but as the law currently stands, it does appear to be more complex, at least from my point of view. Note: I am absolutely not a legal expert.
- jtolmar 4y agoThe new technology looks like it could threaten artists' livelihoods by replicating something about their work. The old legal framework for protecting artists' livelihoods from photocopiers etc was copyright. The goal of making sure artists can both make art and eat is still relevant, so people reach for the tool that used to make sure that was possible.
- gernb 4y agoIf it really does make it hard for artists to eat from selling art, that to me is just sour grapes. I mean there use to be 1000s or 10s of 1000s of liveries to lock up your horse. There's no goal to keep horse keepers so they can still keep horses and eat. Instead, their industry mostly disappeared. I'm not heartless but at the point their services are no longer needed that's just the way it is. Cloth weavers replaced by the loom. I don't think SD will replace most top artists for now. It's hard for me to believe SD is going to come up with images like those from top concept artists. But I can imagine SD replacing lots of situations, like maybe stock photography, when you can just ask the AI to draw "people in front of whiteboard discussing sales chart"
- cma 4y agoWe need a different tool than artificial scarcity. Both for copyrights and patents. Government funded prize systems and patronage systems with a lot of mechanisms for citizens to choose what to fund seems ideal.
- astrange 4y agoOnline artists esp. fanartists have a strict moral system with rules like “credit the original artist” that isn’t based on actual laws, so they’re upset about this.
- dkjaudyeqooe 4y agoI think that's wishful thinking. It's objectively a mechanical derivation based on many copyrighted works. In many cases it's going to reproduce some works with not that much transformation. What's a similar thing that has come before this? I can't think of any, this is very novel. You'd want to wait for some rulings before you jump to conclusions.
- elevaet 4y agoIt might be similar to some forms of (human composed) sample-heavy music which use bits and pieces from many different songs to create something entirely original. As far as I understand it, this is still considered copyright infringement in most IP law systems. (If the samples aren't cleared)
- grumbel 4y agoFair Use is a defense, not a right. Just being transformative isn't enough here, that's just one of many different factors that needs to be checked. Furthermore Fair Use includes evaluating the effect an infringement has upon original work's value. So when your image generator keeps spitting out Gettyimages watermarks, while you are building a service that is in direct competition with Gettyimages for stock images, there is an argument to be made that Fair Use really doesn't apply here. As what you are doing is essentially stealing Gettyimages' work, AI laundering it and selling it back to their previous customers. With StableDiffusion a Fair Use defense might have an easier time, as the results are released to the public. But it's still not exactly clear cut. If you type in "Mona Lisa", you'll still get something that looks like a copy of the Mona Lisa, not like an original work.
- ItsMonkk 4y agoCreating and allowing public use is a positive externality. Negative externalities should be taxed, and positive externalities should be subsidized. Everyone should be able to freely use any public works, and governments should ensure that people whose art is being used to train these models are able to continue to do so.
- gernb 4y agoHow about some company just make site that licenses art. In secret they run SD to generate images forever. They use image search to search for similar images on the net and claim copyright. PROFIT!!!
- slim 4y agoWhat will happen is AI will be fed IP legal corpus as part of training. It will only show images that can't be linked (in a justice setting) to any particular work. Which will be interesting because it will produce media culturally alien but still appealing and probably addictive. It will literally be the engine of advancement of human culture. I'm not the conservative type, but I'm still slightly concerned as much as fascinated.
- falcor84 4y ago>What will happen is AI will be fed IP legal corpus I first read this as a prediction that AIs will be employed to generate future IP legislation, and now I don't know if I'll be able to go back to sleep.
- simonebrunozzi 4y agoCan you summarize what’s the HBO debacle?
- michaelchisari 4y agoAfter using SD heavily for a week, I half agree with this. It is incredibly disruptive, and it's wild how much it accelerates the creative process. I'll give you that. But two things I've noticed: First, artists will still have a massive advantage over non-artists with this tool. A photographer who intimately knows the different lenses and cameras and industry terms will get to a representation of their idea much faster than someone without that experience. Without that depth of knowledge, someone might have to rely instead on random luck to create what's in their head. Art curators might be well-positioned here since having a wide breadth of knowledge and point of reference is their advantage. Second, we need the ability to persist a design. If I create a character using SD, I need to be able to persist that character across different scenarios, poses, emotions, lighting, etc. Based on what I know about the methods SD/Midjourney/Dall-E are using, I'm not sure how easy this will be to implement, or if it's even possible at all. There will always be subtle differences and that's where being an artist who can use SD for inspiration instead of merely creation will retain their advantage over a non-artist. That said, holy crap. This tech is insane.
- canjobear 4y ago> Second, we need the ability to persist a design. I See yesterday's Stable Diffusion article: https://news.ycombinator.com/item?id=32643564 https://news.ycombinator.com/item?id=32643564
- michaelchisari 4y agoI haven't had a chance to try it yet, I'm optimistic but skeptical that it can have true persistence like I'm referring to. Especially since it requires training your own model which requires multiple images of the same asset/character/object/etc.
- deleted 4y ago[deleted]
- nomel 4y agoFor what I think you have in mind, I suspect it will eventually not be "image to image", but "<ai thing> to <ai thing> + image", for that guess to be remotely repeatable. That "ai thing" is probably the persistence you're talking about. I think that thing will neccesarily contained representations of dimension, behavior (physics/bones), and "style". Without the "ai thing", if only using an image/text, the character would have to be impossibly represented in the model, so it could guess all of these things predictably. For example, what that character looks like from a side profile, or behind. What if it's an alien, and its arms should always bend backwards? Could a text representation ever be made to completely describe this, with good reproducibility? Probably not. But, I assume some non-human representation would have a better chance. As is, if something known is required, I think the behavior of these models can be considered "destructive" to the input image, more often than not. For this reason, I think artists are safe, for the time being. :)
- LastTrain 4y agoWhy is every image I create made of 100% nightmares
- akira2501 4y agoThe faces are particularly creepy. They range between fever dream and uncanny valley. https://imgur.com/a/LexTjLK https://imgur.com/a/LexTjLK
- noneeeed 4y agoThis is why I think some of the hype is overblown. This is definitely really important, but these systems generate output that is frequently off or incoherent in really important ways. I think this is going to lead to some fascinating art, but stories of the death of art are wildly premature.
- aembleton 4y agoI think its because we've eveolved to be more sensitive to faces and pay more attention to them. I suspect the whole image is off, but we really notice it in faces and particularly the eyes.
- macintux 4y agoActive discussion today about Stable Diffusion: https://news.ycombinator.com/item?id=32651556 https://news.ycombinator.com/item?id=32651556
- fragmede 4y agoThere are a total of 4 posts related to StableDiffusion on the front page right now
- macintux 4y agoI suspected there were more, but didn’t spot them at a glance.
- caporaltito 4y agoNo wonder... This is something quite disruptive
- ryandv 4y ago
- bowsamic 4y agoPretty much any ethical discussion about race is suppressed on HN because this is a “Silicon Valley neo rationalist” site Liam Kofi Bright outlines this with the Represser archetype in his new essay “White Psychodrama”
- andybak 4y agoYou are exaggerating. HN is fairly broad in it's politics and there's often quite challenging discussions around topics related to diversity. Whilst there is a tendency towards "Silicon Valley neo rationalist" and other voices are sometimes in the minority, you using a term like "suppressed" comes across as slightly overdramatic.
- bowsamic 4y ago> you using a term like "suppressed" comes across as slightly overdramatic. I don't think so, because the person I was responding to was flagged. Abusing the flagging functionality to silence difficult opinions about race is not uncommon on this website
- deleted 4y ago[deleted]
- andybak 4y agoWhether I agree or not, I have my own thoughts as to why that comment was flagged and it's not because it was "difficult opinion".
- amval 4y agoProbably because: 1. You don't make any actual point that could lead to a constructive discussion. 2. What you are saying is not true: this model was developed in an university in Germany and sponsored by a private company. The only public founder I could find is this one: https://www.crunchbase.com/person/emad-mostaque https://www.crunchbase.com/person/emad-mostaque Perhaps you should reevaluate your own biases as well.
- betwixthewires 4y agoOne day, images generated with these AIs will become ubiquitous online, and new AIs training on data will wind up with feedback problems because they got trained on photos that are AI generated, possibly even ones they themselves generated! This tech is a huge deal. Huge. Ubiquitous unique, beautiful art. Entire movies made by machines. Too many to even watch them all. Actor models that aren't real people owned by the thousands by people and corporation s.
- nr2x 4y agoHow many search results are forum posts with some asshole saying "let me google that for you" to the exact question you are asking? Haaaaaate that.
- denimnerd42 4y agoor when you try to google something that would better be answered by a professional that costs $1000/hr like doctor or lawyer but you just want a vague idea of the landscape and all the answers are "you need a lawyer/doctor" and not any real attempts at an answer. just shutup!
- ipaddr 4y agoImages generated have a watermark that can be used to filter.
- Morgawr 4y agoThe images I generate don't have a watermark. Same applies for a lot of other AI generated images. The watermark is the most trivial part to remove and is definitely not a defining feature of what makes an image AI generated.
- ipaddr 4y agoIf you use one of the ui or don't remove the watermark (99% of people won't) then search engines will be able to filter those stable diffusion images.
- nr2x 4y agoThese systems make for a good family game in our house. We take turns with prompts and have the laptop broadcasting to the TV. I imagine you could make a more formal party game from it - some sort of weird version of Pictionary perhaps?
- ecolonsmak 4y agoYah, you'd have to guess the input text that generated the image.
- nr2x 4y agoI'm honestly going to think about game ideas and try some with the family. It's fun to play with these models on your own, but it's way more fun with a group of people laughing and one-upping. (Also, very happy for somebody to steal this idea!)
- paulpauper 4y agoWhy do Stable Diffusion images all sorta look the same. They look either deformed or like pastels . I tried it a few times on some free sites, and it was not accurate. I would put in 5 keywords and maybe it would get 2 of them right. These are common search terms.
- iLoveOncall 4y agoYou have to really spend a lot of time to build the prompt to get something nice and not generic. I encourage you to check out the subreddit where people share some prompts that you can reuse. There's usually only a part that describes what is in the image, while half the prompt will be used to describe how does the image look. Thinking of this one for example: https://www.reddit.com/r/StableDiffusion/comments/wp26lp/i_spent_the_last_few_days_trying_to_get_a_clean/ https://www.reddit.com/r/StableDiffusion/comments/wp26lp/i_s... I have reused it successfully.
- andybak 4y ago> These are common search terms. It's not a search engine. It takes a while to get a feel for what prompts work and how to phrase things. I suggest browsing https://lexica.art/ https://lexica.art/ and using some prompts from there as a template.
- BonoboIO 4y agoI tried SD for a bit and the results are at best mediocre. Dalle2 is dimensions better at understanding prompts, but it’s still a beta. So there is hope.
- mullingitover 4y agoLinux started out pretty mediocre compared to closed source Unix, and even today there are operating systems that are better, but being freely available made it a game changer. I don’t foresee Dalle2 being open any time soon.
- stableskeptic 4y agoI'm struggling with the connection you're making between Linux and Stable Diffusion. Linus didn't invent the core concepts of Unix. He copied the (arguably) good parts from an (arguably) closed ecosystem. His big innovation was leveraging the internet to create a new kind of community not really seen before it. The Linux bazaar gave smart developers excluded from the Bell Labs / BSD cathedral a place to be productive in that style on their own terms and others used it to disrupt the OS business. A lot of shit gets into Linux that the community turns into useful things. I look at the inputs/outputs of Stable Diffusion and am reminded of the fractal craze of the 80's which revealed the underlying simplicity of incredibly complex looking things. Lots of interesting art and technology came out of that but I don't think anything like the Linux community did.
- mullingitover 4y ago> I'm struggling with the connection you're making between Linux and Stable Diffusion. Stable Diffusion is open source, and was being compared unfavorably to a technically superior but closed source system.
- senectus1 4y agoI'm no artist.. though I'll admit i dabble, but is it just me or does everything that is generated in this seem to lack emotion? I have seen some very impressive pictures but nothing that seems to "emote"
- abledon 4y agoyeah one thing I think of is when an artist 'creates' something, its coming from their brain, like expressing what they feel. When AI generates the Art, even though there is a human curator, the lines and shapes the AI picks out is all random/arbitrary/no-emotion (even though it draws upon a huge dataset of lines/strokes/styles to form). It's "noise" art. The noise is just cleaned up to resemble real things.
- astrange 4y agoIf by emotion you mean faces then that’s just a lot of data to fit in the model. The rest is up to the skill of the pilot. You can do a lot with color palettes for instance.
- senectus1 4y agono its more than that... there is no "atmosphere" to them. they're just clean images. Its hard to explain.
- astrange 4y agoThey are very clean looking, it could be an effect of SD's compression to be so small. MidJourney's production model is good about dirtying things up, you could use it as a post processor. I think its default style of turning everything into fine art-cyberpunk-movie matte painting gets old though. I've gotten some good atmospheric photorealism results out of DALLE, but currently trying to get outpainting to work to extend them and it's tricky.
- up2isomorphism 4y agoYou are not alone. The emote feeling is Because the complexity is not there. Human being never characterize the world with linear rules.
- Ono-Sendai 4y agoWhy did they call it diffusion? It's not diffusion. It's addition of noise (noising)
- simonw 4y agoHere's a good explanation: https://www.assemblyai.com/blog/diffusion-models-for-machine-learning-introduction/ https://www.assemblyai.com/blog/diffusion-models-for-machine...
- zzo38computer 4y agoHaving seen some of the pictures of AI art (I don't know if they use the same or different programs or models), my opinion is that the pictures are not good enough, although sometimes they are almost good enough. (I think there might still be a use for it, despite this. Some other comments mention some possible ideas, although there may also be others.)
- Gigachad 4y agoIt's rapidly getting good enough for things like stock images for blog posts. Where you just need an image vaguely related and don't want to pay for an actual stock image.
- pavlov 4y agoAfter the novelty wears off and everyone has already seen tons of these automatically generated images, will writers still want to adorn their blogs with these generic illustrations? Or will it turn negative: "If you have nothing to say, add an AI illustration." I could see it becoming a marker of low-brow taste where vaguely related illustrations become something akin to decorating your home with velvet paintings of Elvis.
- LanternLight83 4y agoPrompt writing is a challenging and creative endeavor like any other, and a well-written prompt/image need not be mearly "vaguely related"; Certainly not in comparison to the stock images that are already utilized today.
- zppln 4y agoWhile I agree that they usually look pretty bad (and that the resolution is too low), some of them have been on par of what I've seen in video games. Stellaris in particular comes to mind (my memory might not serve right, haven't played the game since release). So I think what we're already have is good enough for some use cases.
- seibelj 4y agoI am a contrarian by nature. Wearing my investor hat, I continue to be unimpressed with AI tools, including the latest image generation enhancements. I do find stable diffusion interesting, but I don't see the disruption. Similarly, I don't see the disruption from Github Copilot considering I run a company full of highly paid and extremely skilled developers and not one of them uses copilot. How often have you wanted to hire a conceptual artist? I have never done so in my life. While I have visited many art museums and appreciated it, this has not affected my commercial endeavors. I think if I was a creative writer or professional artist, the current generation of AI tools could be useful for inspiration. But the bar for quality is just so, so high in the creative industries, I am not concerned that AI will replace them. It's September 2022 - where is my self driving car?
- mjmj 4y agoJust gotta install open pilot.
- astrange 4y ago> It's September 2022 - where is my self driving car? Nearly impossible because logic doesn’t work in the real world like it does to make pictures. https://en.wikipedia.org/wiki/Moravec%27s_paradox https://en.wikipedia.org/wiki/Moravec%27s_paradox https://metarationality.com/rationalism https://metarationality.com/rationalism I can think of two good businesses you could build with SD right now. Neither of them are text to image models or necessarily "art", both involve using it to visualize other kinds of sensing by transforming them to image embeddings.
- orbital-decay 4y agoMoravec's paradox is actually an observation only relevant to 80's state of robotics and AI. I don't think it holds true, and low-level stuff does absolutely not cost more than high-level stuff. What holds full self driving back is the vast amount of rare edge cases that can't be dealt with by current methods. (largely because the system is only trained on available data and doesn't understand first principles)
- 4y ago
- choeger 4y ago> No-one expected creative AIs to come for the artist jobs first, but here we are! Maybe that's because we never really thought about it. In hindsight, it's only logical. For an artistic rendering, correctness doesn't matter much nor does understanding the model. For flying a plane or driving a car or just transforming code from one language to another, it very much does.
- astrange 4y agoThere are some kinds of “correctness” that matter. When you’re doing something new, you can only really do one new weird thing at once. Too many weird things and it falls apart or distracts the viewers. (The “cow tools” Far Side comic is a dumb example.) Since these AIs can’t count, that extra weird thing is probably going to be people with too many fingers. I actually have a personal collection of weird Midjourney images because if you ask for wide aspect ratios it starts generating multiples of the same thing and fusing them together…
- abigail95 4y agoSurely the best people to create new art from models like this would be artists themselves? Wouldn't this create more jobs for artists? It's just a different tool
- TulliusCicero 4y agoThat depends on how easy it is to use the new tools. Getting higher level languages and various libraries/frameworks didn't make coders obsolete, because there was still tons of work to do at a "higher level" that required algorithmic/engineering-style thinking. Yes, previously difficult tasks got a lot easier, but that just meant that even more ambitious projects could be tackled, and that was useful. In contrast, it may be the case with art that the things a relative newbie can spit out with the help of image generation models are "good enough" for most use cases. Yes, a real artist would be able to squeeze out even more, but many companies may be willing to go with the option that's enormously cheaper and still seems to produce okay results.
- 4y ago
- aquafox 4y agoStabile diffusion is most of all a waste of resources! 20 billion parameters trained, using I dont know how many CPU hours, all for making better artistic images than what an amateur would do and on par with professionals. Art is nice, but not important for survival, contrary to smartly using the resources of the planet. Do you want to see a future way to live on or "the rest of Mona Lisa"?
- bhedgeoser 4y agoCommenting on HN is necessary for survival?
- vanviegen 4y agoWhat's the next step? Generating 3d scenes out of these images? Would that be feasible?
- ma2rten 4y agoYes, check out Neural Radiance Fields (NERF).
- deleted 4y ago[deleted]
- overtonwhy 4y agoMovies and TV shows from classics should be relatively easy?
- abhisuri97 4y agoI’m more trying to see what the utility of stable diffusion (or just the text to image problem) in the long term. Right now people can play around with making weird art pieces and maybe it will be integrated into design tools...but then what? Eg with other AI problems out there I can see a potential application to medicine, self driving cars etc, but I just don’t see what the bigger goal of this is going to be.
- stocknoob 4y agoMagazine illustrator, concept artist, stock photography, video game art asset creation, logo generation, interior design, fashion design, costume design, political cartoonist, caricature artist, website layout templates, font design, pixel art, book covers, children’s toy plush design, new car concept prototype…?
- dogcomplex 4y agoThat's just existing industries. All the new crazy stuff it'll unlock... Custom operating system interfaces for everything based on the data they're working with, truly-open infinite video games where you can run or zoom any direction and have it write itself, bespoke lcd wallpaper customized on the fly to the person walking by, bespoke industrial design creating 3d objects (first digital, then printed) for exactly the context they're needed for merely materials cost...
- deleted 4y ago[deleted]
- phillipcarter 4y agoI'm not really sure I know how to use these tools. I tried the following prompt: "elon musk giving donald trump a massage using pizza sauce instead of oil, in a majestic room filled with flowers and golden toilets" ...and the result was a crappy AI-generated picture of not-quite donald trump holding a terrible rendering of a pizza, and some hands sticking out of random places. There were some red flowers in the picture at least. I realize this isn't a "serious" use case, but clearly the tech isn't doing what I'm hoping it does. I tried "coffee beans with cartoon mouths" and it's just a picture of some coffee beans. I don't get it.
- usgroup 4y agoyeah i'm getting the same. pick something much simpler like: "A cup on a plate". And then replace cup for other objects. It generates nonsense pretty quickly. It seems most able to generate stuff close to something which already exists in a complete form. Sort of a pastiche machine.
- akomtu 4y ago"some hands sticking out of random places" That's the absense of reason sticking out: the "ai" mimics, but doesnt understand, so its creations are frankenstein-like bodies, almost human and for this reason more revulsing. So this "ai" represents an insane painter.
- hackerlight 4y agoIt's only good at prompts that ask it to do a non-photorealistic artistic style. All the photorealistic attempts are bad.
- andybak 4y ago> All the photorealistic attempts are bad. I wish people would stop exaggerating or making statements without some insight behind them. I've seen hundreds, if not thousands of photorealistic result that range from acceptable to remarkably good. One example it took seconds to find: https://lexica.art/prompt/3fbc30ee-ca0f-42f6-8ea5-6890d469abb4 https://lexica.art/prompt/3fbc30ee-ca0f-42f6-8ea5-6890d469ab...
- up2isomorphism 4y agoHonesty I find the pictures it generates are very boring to look at, in fact the original picture has some cute quality in it, although being terse. I think this applies to all AI generated images though.
- up2isomorphism 4y ago“They look amazing “, sorry you have a very bad taste.
- usgroup 4y agoI've been trying to get it to draw a picture of a man trapped inside of a light bulb. Can anyone think of a prompt that works? It draws all sorts of freaky things featuring men and light bulbs but none with the former inside the latter.
- usgroup 4y agoTry "a green field with sheep on it" versus "a green field with robots on it". From a human position that feels like it should be a simple juxtaposition of objects onto a background. Clearly not so for this model.
- fragmede 4y agoBest I got was https://imgur.com/a/g9XcB2a https://imgur.com/a/g9XcB2a
- usgroup 4y agothank you -- that's something I guess.
- fastball 4y agohttps://supernotes-resources.s3.amazonaws.com/direct-uploads/de24c570-560d-4f29-bdff-9e1a8831af84--DALL%C2%B7E%202022-08-31%2015.52.09%20-%20a%20prisoner%20trapped%20inside%20of%20a%20giant%20lightbulb,%20banging%20on%20the%20walls,%20no%20hope%20of%20escape,%20all%20hope%20is%20lost,%20gritty,%20extreme%20detail.png https://supernotes-resources.s3.amazonaws.com/direct-uploads...
- thirdlamp 4y agoIs anyone training networks to detect deep fakes? As in you feed it an image and it gives you if it’s a real image or a deep fake
- endorphine 4y agoAnd then someone will train a network to create images undetectable by the networks that detect deep fakes.
- nivenkos 4y agoThat's how GANs work...
- madiator 4y agoRegarding the ethics. Thought experiment: I look at a copyrighted image, get inspiration, and then draw a new image (which is not the same as the copyrighted image). Is that ethical? But if I do this millions of times, after looking at millions of copyrighted images, is it still ethical (as long as I don't recreated copyrighted images)? Tough questions!
- prox 4y agoIf it sufficiently different from the original. So no one would confuse your new idea with the old. That’s how I was taught anyway. So Donald Buck who is a duck is too derivative, but Ronald Cluck who is a bear might be fine.
- jcelerier 4y ago> Is that ethical? Depending on how close it is it may not even be legal. To give a music analogy: at least in my country, if you take a melody, change all the notes' durations, and transpose it you'd still infringe
- michaelt 4y agoThe ethics partly depends on the analogy you choose. I can write a book about a boy wizard's adventures wizard school and that's legal, but if I call them Harry Potter it isn't. I can create Harry Potter fanart and distribute it online pretty freely - but slap it on a mug and sell it, and that's illegal. I can record an audio description of a painting that's as detailed as I like and it's legal to distribute - but take a photograph of the same painting and it's a derivative work, no matter how artistic my choice of camera settings. We don't really have any prior examples that are precisely like these huge ML models trained on copyrighted data - and depending on which imprecise analogy you choose, you can come to a different conclusion.
- abigail95 4y agoHarry Potter is a trademark. It protects and distinguishes identity and authority. It is much harder to get a trademark, and is also harder to fairly use one. Different issue. If your fan art is infringing, it was infringing whether or not it was on a mug or on dropbox. Photograph one is not true. For commentary it can be by audio, or printed on a mug or whatever, commentary is transformative. Go out and take a photo of the world outside, if you live in a city you've captured thousands of copyrighted materials in your image. Maybe it captures someones painting, maybe it doesn't. Whether its fair or not is if it's transformative, the format doesn't matter. I'm not seeing an ethical difference from any of this. Or did I miss the point?
- slim 4y agoOur children will live in a world imagined by AI
- habosa 4y agoThese new models completely changed my mind about how much impact AI will have in my lifetime. They are the most impressive software achievements in decades and anyone who has a “meh” reaction will absolutely end up looking silly. I’m not optimistic that their impact will be positive though.
- colordrops 4y agoIt may be like WWW or cryptocurrency, where it was great the first 10 years then started getting ugly. Could happen much faster this time though.
- heyyeah 4y agoIt is capable of surprising beauty. It will however be as beautiful as the disaster that is modern Facebook -- and the misinformation will be more convincing and subtler.
- SyzygistSix 4y agoI think that the cause of that is unlikely to be Stable Diffusion but the lack of education that allows so many educated people in this thread to mistake images for art. In that way a lot of the damage has already been done.
- swalsh 4y agoThis is happening with images first, but I can see how this might be able to be leveraged for all kinds of things. The speed at which society might be transformed could be astounding. But it won't be distributed evenly, not everyone is prepared to take full advantage of these benefits. This is early 2000's internet distruption x2 in half the time. BUT it will likely be disrupting the upper middle class more than the lower middle classes, as it's mostly disrupting to creative work. Upper middle class people have a louder voice.
- Tomis02 4y ago> They are the most impressive software achievements in decades and anyone who has a “meh” reaction will absolutely end up looking silly. With the risk of looking silly, I declare "meh" once more, just as I "meh"-eh when GPT-3 came out. The so-called "AI" is not fundamentally different from the AI of the 80s, it's just that now we have much better hardware. The main problem of the past AI winters still remains - the existing algorithms focus on statistical methods, which can be rather inexact. Imagine a nuclear plant controlled by an AI, or an airplane flown by a neural network. They completely lack reasoning capability and therefore you can't trust they will be able to adapt to unpredictable situations.
- lulwhatyouex 4y ago>You can use it for commercial and non-commercial purposes, under the terms of the Creative ML OpenRAIL-M license—which lists some usage restrictions that include avoiding using it to break applicable laws, generate false information, discriminate against individuals or provide medical advice. What I'm going to do is take all those new image-generation AIs, and use them to train an image-generation-AIs-generation AI, this way I won't be bound by copyright anymore.
- seydor 4y agoI think the discussion about artists is premature, but the power of releasing something for free cannot be underestimated, again
- andy_ppp 4y agoIs this going to start changing the world as much as search did? My guess within 10 years AI will have changed everything, it won’t look like AGI but it’ll be good enough to be better than humans at most creative endeavours including things like generating whole films and possibly games with a few carefully arranged text prompts and start images. Quite terrifying. I wonder if it will be possible to train a neural network to do our programming tasks for us?
- machiaweliczny 4y agoIMO math > programming > rest is the order. On proof search there’s a lot of prior-work. Programs are super easy and cheap to verify or simulate/generate. BTW I bet that even if you aren’t using copilot VS Code collects your input as training data. With programs it’s not necessary to understand NL, might as well work as show me example of input->output
- greggman3 4y agoReading about how it's done it's not so clear those other things are close at hand. Most of these SD things generate very low-res images and then use upscaling to make them high enough resolution that they don't look like crap. Apparently the computational power required to make them larger grows exponentially (or geometrically?) so until we find new algorithms it might be a long time before the same technique can generate whole films and games and any coherent way. Of course maybe that breakthrough will be announced tomorrow.
- andy_ppp 4y agoAre we sure the rate of improvement in these algorithms won't continue?
- Barrin92 4y agoNo, I don't think so. AI generated art that can fool humans has been around for years (7 years ago: https://www.nbcnews.com/tech/innovation/computer-generates-music-rival-bachs-n414066 https://www.nbcnews.com/tech/innovation/computer-generates-m...) and it changed very little, nobody listens to robo-Bach. In art humans always look for novelty and authenticity and not for mechanical reproduction, which quickly becomes generic. When every guy or girl on the planet could create a DeviantArt account and start drawing, did that have an impact on professional art? Not really. We've increased the total artistic output and reduced cost several magnitudes over through tech, and if anything it's increased the demand for human novelty rather than reduce it. But as soon as the 'AI' label gets slapped on it people start to have weird Terminator fantasies.
- simultsop 4y agoAre there any standards/frameworks emerging on how to write texts/prompts?
- andybak 4y agoNot sure what you mean by "standards/frameworks". It's an art rather than a science. Some of the tips passed around smack somewhat of cargo-culting, some genuinely make a difference. Everyone has their own approach and some techniques work for one topic but not others.
- simultsop 4y agoI meant like some sort of functions which would provide you ability to reuse a character per se, in future prompts.
- andybak 4y agoThe closest thing I know currently is https://textual-inversion.github.io/ https://textual-inversion.github.io/
- fleddr 4y agoThere's even a brand new word for it: prompt superstition. "8k, highly detailed, ultra super very detailed, epic lighting, octane render"
- thrwawy74 4y agoI am excited thinking the next generation of video cards will all have 10GB of memory from the mid-tier up. This is going to push up the requirements of some of the enthusiast GPUs for non-gamers.
- 01100011 4y agoDoes anyone know if it's possible, with a high end gpu or relatively cheap cloud provider, to use transfer learning to extend the model with in-house images? I think it would be useful to customize the output for certain genres or applications.
- wingshayz 4y agoSome of the tech and especially the platform they're building is impressive, but in terms of raw image generation quality from results I've seen and my own experience, I don't find it anything close to DALLE-2
- colordrops 4y agoJust compare what was proprietary a couple years ago to what is open now. What is publicly available will be better than DALLE-2 in short order.
- iLoveOncall 4y agoReally? I find the output to be in general incredibly better than DALL-E. If you zoom in on a DALL-E generated image the illusion falls appart and you can see it's a vortex of pixel that fuzzily creates a shape. So far my experience with Stable Diffusion is that, no matter how basic the prompt, the ouput will be sharper and more coherent.
- deleted 4y ago[deleted]
- planb 4y ago> Stable Diffusion has been trained on millions of copyrighted images scraped from the web. My brain has been trained on even more copyrighted material. Every book I read, every tv show I watch, the toys I played with as a child. It's hard to imagine that I could come up with anything that is not inspired by copyrighted work.
- batmenace 4y agoI would assume that the point is that you had to pay - in one way or another - for access to this material, which is the intention when it is published and shared. You bought your books, your toys, your TV shows (through ads). SD, by scraping the web, gets all the benefits of prior work without necessarily having adequately compensated the work's creators.
- contravariant 4y agoI'm pretty sure I didn't buy any of the images I view while browsing the web. Sending me ads doesn't constitute a transaction, besides I usually don't choose to look at them anyway.
- odessacubbage 4y agoyou also didn't flip millions of illustrations into a commercial product without paying the creators or rights holders to license them. this is theft plain and simple.
- thegrimmest 4y agoI think the point is that he did, and that we all do, when we train our meat neural networks (on copyrighted material) in a way that makes us better at providing a commercial service (our job). If a human has a right to view and learn from a copyrighted image on the internet, why shouldn't an AI?
- planb 4y ago
- mpaepper 4y agoShameless plug if you want to understand how stable diffusion actually works: https://www.paepper.com/blog/posts/how-and-why-stable-diffusion-works-for-text-to-image-generation/ https://www.paepper.com/blog/posts/how-and-why-stable-diffus...
- barrenko 4y agoStill looks like crap, in the same way that a CGI sequence in a movie jumps out to someone who is a gamer. (In my very modest modest opinion).
- andybak 4y agoWhen witnessing a huge leap forward in human technological achievement, doesn't it feel a little strange to respond with "looks like crap"? Even on your own terms, you're engaging in hyperbole. I've looked though thousands of these images and the harshest I can come up with is "assuming the result isn't obviously broken (i.e. some generated anatomy) then the results are sometimes a little bit uncanny or 'off'")
- deleted 4y ago[deleted]
- nluken 4y agoIt seems like AI image generation is close, but still slightly "off" as you say. To me it remains to be seen whether that's actually a huge achievement, or whether there's more work to be done to achieve that last 10% than has been done so far. The poster you're replying to used gaming as an example, and you only have to look there to see how graphical improvements in the last 10 years have diminishing returns versus earlier improvements. I could be wrong but this seems like an area where our progress will look like an S-curve. Getting that last 10% could be the real achievement.
- nvln 4y agoMy son is an artist and we have conversations around AI generated art almost every week these days. Our general consensus has been: 1. Artists that use SD etc., will save a lot of time and have a big edge. Example: Generating references instead of searching for them, Generate random inspiration(s) for abstract ideas, Variations of a particular idea to compare and contrast. 2. Non artists who have powerful imagination but lack the artistic skill will stand to benefit as well. For example, I look forward to generating visual companions for my poetry, essays or fiction. I have the choice of commissioning an artist if my piece is successful. 3. Artists that are purists and masters of their craft with a very unique style will continue to thrive in their niche. These people have to lobby and come up with a license that explicitly prohibits feeding their images for learning. But a skilled artist can replicate the style and feed it. There is an ethical line here that may require creative tweaks to existing laws to protect people that fall in this category. Super exciting tech and I can't wait for this to move over to 3D models. I know 2D image to 3D model is already pretty close to being real(nvidia ominiverse, nerf etc) and SD can be the starting point of that pipeline. Prompt -> 3D world that can be decomposed to meshes, textures and USD will change the game development landscape quite a bit.
- mattmanser 4y agoSo I just tried beta.dreamstudio.ai, and am a bit underwhelmed.. It's compositions generally look silly or completely ignore the instructions, even if I turn cfg way up. I was generally generating 9 compositions at a time, here's some of the things I've tried: "An elf fighting an orc in a forest" Half the images had christmas elves so it's obviously bad at context, half looked like miniatures (models like games workshop), so it's obviously got a load of its data from pictures of miniature but doesn't realize and thinks that's what it should draw, and the "fighting" always looked pathetic. "A human berserker with an axe fighting 3 orcs in the desert" That had problems with actually putting a human in. Also no axe. Orcs designs were obviously stolen from LotR films orc design, the actual breath of orc designs in fantasy didn't seem to be represented at all. Often the weapons are for some inexplicable reason only part drawn. "A space elevator leading up from new york" Was a little more promising, but looks pretty amateurish, just a picture of a space elevator transposed over a picture of new york with terrible lighting, though it was choosing half decent perspectives. "A 12th century castle on a hill in a hellscape surrounded by demon hordes" Pretty much ignored everything after "castle", just a bunch of 12th century looking castles. "A castle on a hill in a hellscape surrounded by demon hordes" None of the 9 images generated has any sort of demons, it just coloured some castle a bit red. I think artists are safe for another few years.
- ccozan 4y agoI am repeating myself from another SD post here in HN [1] "I mean, what stops us a life-imitates-art system where we have speech2img like in the Westworld ( the narative creating scenes ) ? I guess, I hope someone reads this and will pick up this. Maybe coupled with a VR set?" Now I really hope on this :) Imagine giving this power to kids ( they cannot write but talk! ) [1] https://news.ycombinator.com/item?id=32647792 https://news.ycombinator.com/item?id=32647792
- ManuelKiessling 4y agoI've started an open source implementation of a Discord bot that turns your prompt into images using Stable Diffusion [0]. It would be great if this would turn into a community-driven chat-based text2image offering - which is certainly challenging as the required GPU-powered server instances aren't exactly cheap. Maybe this could grow into an open network where people provide the GPU power of their personal PCs? Or we find a way to cover hosting expenses through a credit system or some kind of sponsoring? Feel welcome to join the community [1]. You can easily test drive the current Bot implementation on this server. [0] https://github.com/manuelkiessling/stable-diffusion-discord-bot https://github.com/manuelkiessling/stable-diffusion-discord-... [1] https://discord.gg/nsfeutx35z https://discord.gg/nsfeutx35z
- ssizn 4y agoI tried to find where the implementation in your code is but there are like a thousand files spread over a hundred folders.
- ManuelKiessling 4y agoYou... are trying to troll me, right? % find . -type f ./migrations/Version20220723092633.php ./composer.lock ./.env.local ./bin/connect-to-db.sh ./bin/_init.sh ./bin/deploy.sh ./bin/visualize.sh ./bin/console ./config/services.yaml ./config/bundles.php ./config/packages/messenger.yaml ./config/packages/framework.yaml ./config/packages/doctrine.yaml ./config/packages/translation.yaml ./config/packages/cache.yaml ./config/packages/routing.yaml ./config/packages/doctrine_migrations.yaml ./config/preload.php ./config/routes.yaml ./config/routes/framework.yaml ./public/index.php ./symfony.lock ./.env ./composer.json ./.env.local.dist ./src/SymfonyMessageHandler/VisualizeSymfonyMessageHandler.php ./src/Command/BotRegister.php ./src/Command/BotRun.php ./src/SymfonyMessage/VisualizeSymfonyMessage.php ./src/Kernel.php
- ssizn 4y agoYou conveniently omitted all folders with gitignore files.
- egeozcan 4y agoNow there are so many very successful description -> image research and tooling, I find it surprising that most of the image -> description/labels solutions are closed source and/or paid. BTW generating images using Anaconda on Windows using my RTX 2080 Super was very easy (followed the instructions here: https://rentry.org/SDInstallGuide https://rentry.org/SDInstallGuide ). The only thing was, because it has just (!) 8GB of ram, I had to use --H 256 --W 256 to limit the output image to its minimum size, which barely fit into its memory.
- Timwi 4y ago> the model can be seen as a direct threat to their livelihoods. When is somebody going to point out that this isn't Stable Diffusion’s fault, but capitalism’s? Why are we willing to stifle innovation for this instead of first making sure that everybody can live and create?
- quitit 4y agoI've said this ad nauseam - but people who think this is going to kill an industry clearly have no idea of said industry. It's a fantastically great tool, and a very exciting space, but reducing the function of creatives to people who draw pretty pictures is staggeringly ignorant.
- zulban 4y agoLive music didn't disappear but the industry took a huge permanent culling when any cheap venue could just play a track. The replacement doesn't have to be great to trash an industry. It just has to be good enough for most. This is.
- quitit 4y agoIt's not a good comparison. A better comparison is like saying AI text generation bots will replace authors, or that AI drug testing will replace drug development - which clearly isn't the case. The core issue is that people with no idea what the creative fields offer are throwing their hat in with what they think is going to happen. People with experience are saying the opposite because they know better. At best, this will remove those websites where you can pay $5 for "a designer" to make you "an image" - is this a loss though? Such things have never been a threat to creative fields.
- kjkjadksj 4y agoHow about the fact that you can go on github today and find a thousand ml based music generators probably, and yet people still like going to concerts and seeing an artist play an instrument.
- fleddr 4y agoNot a meaningful comparison. Seeing an artist play an instrument is a fundamentally different experience. It's visual, much more impressive sound, a social experience, and so on. With imagine generation you just look at output. There's no difference between seeing the output of a human-created image or an AI-created image, people can't tell.
- daemond 4y agoSD is so popular these days. It has been on the top of GitHub trending for a long time, last hour, last day, and even last week. https://ossinsight.io/#trending-repos https://ossinsight.io/#trending-repos Is it because it represents that AI can do things that humans thought would never be replaced by AI before?
- belter 4y agoInterview with Emad Mostaque Founder at Stability AI: https://youtu.be/YQ2QtKcK2dA https://youtu.be/YQ2QtKcK2dA
- HelloNurse 4y agoPlaying with the prompt-only demo at https://huggingface.co/spaces/stabilityai/stable-diffusion https://huggingface.co/spaces/stabilityai/stable-diffusion I got the impression that many apparently harmless requests corner the model into a very sparse set of examples exhibiting extreme bias and utter nonsense. For example (seed 0, other advanced options at default values): Blue hamsters filling donuts with nails mostly edible donuts and quasi-donuts; some blue, but no hamsters and no nails. purple hamsters in free fall, eating gold nuggets no free fall, some purple objects and backgrounds, somewhat metallic hamster hair, a five-limbed black and white hamster, credible gold nuggets without rodents, eating hamsters without food, multiple almost identical instances of eyeless white and yellow hamsters in the same pose. Martian hamsters wrestling generic reddish hamsters, not wrestling at all. a hamster is the CEO of a financially struggling startup, in San Francisco remarkably standard hamsters, in somewhat office-like environments (wooden tables and harsh light), with curiously unbalanced camera angles that might be random or inspired by the source material. the most beautiful hamster in the world, parading on a toy car and wearing sunglasses No complete pair of sunglasses, but an interesting hybrid between round black lenses and round black hamster eyes; unusually deformed hamsters; an incoherent furry thing with a plastic part floating in the air; a deformed toy car with its back nicely replaced by a hamster. Vampire hamsters feeding on unsuspecting tourists in a dirty alley No vampirism and no tourists, but nice dirty alleys. I insisted on hamsters because they are usually photographed in very few poses and activities, leading to completely ignored indications.
- jeroenhd 4y agoI think many of your prompts have trouble getting the right representation because you're using a lot of abstract and implied language. For these prompts to work right, you need to be very specific and often add keywords as if you're specifying a mood board. You also need some overlap between what the model has likely been trained on and the expected output. The system works much better in img2img mode. Slapping together a rough shape of what you want in GIMP/Photopea and then applying a prompt to blend everything together make the entire process a lot more reliable.
- salawat 4y ago
- peoplefromibiza 4y agoYeah, it is. It is for authors that got their works stolen for "the greater good" without even being notified. A friend of mine found his works in the Stable Diffusion dataset, the work was not meant for public use, he's never been notified and, most of all, he would have never agreed if they cared to ask. https://laion-aesthetic.datasette.io/laion-aesthetic-6pls/images?_search=LRNZ&_sort=rowid https://laion-aesthetic.datasette.io/laion-aesthetic-6pls/im...
- hbn 4y agoI don't think the word "stolen" applies here, at least not any more-so than I stole from him when I looked at that image. I'm not sure about that website rehosting his image, but in terms of the model people are running on their computers, it's not like it literally includes the image that can be pulled back out of it. A computer looked at that image, and tweaked a very small amount of numbers within ~5GB of numbers based on it. That said, it did get a little better at drawing like your friend from that. But so does every other person who looks at his art. The model however might be better at it than most people. It's a dilemma but it's hard to say any individual image is "stolen" We kinda already went through this once when GitHub scanned all public codebases to build the model for Copilot. When they did that, Copilot got the ability to program a little more like me (sorry everyone). But when I publicly put my code out there, I was also giving people the opportunity to learn from my code and reproduce similar things to it as well.
- peoplefromibiza 4y ago> not any more-so than I stole from him when I looked at that image I spoke with the author, the author disagrees with you. The reason he consider that stealing is because they took that image from the online shop where the disclaimer specifically states "2022 © Magnetic Press LLC by Arenathemes. All Rights Reserved" without even trying to contact the copyright holder. https://store.magnetic-press.com/products/viewpoint-by-lrnz https://store.magnetic-press.com/products/viewpoint-by-lrnz > But when I publicly put my code out there, I was also giving people the opportunity to learn from my code and reproduce similar things to it as well. Not really, IMO I can enter a bookshop and look around, open a book, read some pages and maybe learn something. It doesn't give me the right to republish a similar book putting together what I saw, unless the license specifically grants me that right or I obtained a license that does. Code Pilot is a commercial product, free licenses don't automatically grant the right to commercial use of that code.
- _gabe_ 4y agoIs it just me, or do the comments in this thread seem to be the exact opposite of the sentiment in the comments on similar Github Copilot threads? I just find it a bit ironic that programmers are irate about Github Copilot using their copyrighted material to train. However, if it's an ML model training off of copyrighted artists material, clearly its a transformative work. I just find the opposing sentiments for these scenarios a bit funny.
- mountainriver 4y agoYeah I hadn’t thought of it that way. Curious how designers feel about image generation. I imagine everyone will love AI that doesn’t threaten their job
- scarmig 4y agoI think both are fine. One source of the difference in reception (aside from the selfish aspect) is that the space of work generated by Copilot has fewer degrees of freedom than visual art. So the things it produces are much more likely to be near-identical to existing code than Stable Diffusion is to images. I.e. if SD were just providing near identical copies of artists' work, people would be more sympathetic.
- pclmulqdq 4y agoIf you use my copyrighted code to train your brain and reproduce exact copies of functions I wrote, I have a problem with that. Same for art. Exact copying is the copyright problem. If you use my copyrighted (public) code to train your brain, and then produce new functions that do new things, there is no problem. Replace "brain" with "AI" and you get my position on this (and a lot of others' positions). It seems to be a lot easier to transform art than code.
- lelag 4y agoIndeed. A difference I see between the GPT-like language models and those image generation models is that it feels like the language models actually hold full copies of a lot of sample of the training dataset (hence their ability to recite existing content), whereas the image generation models clearly do not: Stable Diffusion is 4Gb something, yet it can draw anything. That's the amazing part: the training dataset contains 5B images. Yet it distilled all of them in this mere 4Gb of data and can produce an infinite amount of content with those. It really feel like it learned how to draw, in the same sense a human learn and does not simply reproduce exact copy of what it already saw.
- aronowb14 4y agoIt's funny how hyped up stable diffusion is on HN right now: reminds me of when style transfer first started making it's rounds in 2017. https://news.ycombinator.com/item?id=13958366 https://news.ycombinator.com/item?id=13958366 I think as technologists we want to think that code can "solve" some of the problems in the art world... but I think we still have a really, really long way to go. I tried to get style transfer adopted at work (worked at a creative technology firm in NY) but frankly I think deep learning methods for art generation tend to be really unpredictable, which make them pretty hard to use for professional applications. Imagine deploying production code that only worked 85% of the time... would be a nightmare. I felt, and feel similarly about deep learning approaches to art. They're just so finnicky and unpredictable, for example, add a single extra pixel to that example in this article and the output would look completely different. Either way, cynicism aside, stable diffusion is awesome :).
- adamsmith143 4y ago> Imagine deploying production code that only worked 85% of the time... would be a nightmare. I felt, and feel similarly about deep learning approaches to art. They're just so finnicky and unpredictable, for example, add a single extra pixel to that example in this article and the output would look completely different. Don't think the metaphor works. Code that only works 85% of the time is obviously broken but Art is subjective so an 85% solution to a creative problem could be more than enough for most consumers.
- DethNinja 4y agoIt takes 3 seconds to generate 1 image with my GPU. I can find a good prompt within 30 minutes to 1 hour. My GPU can generate 100 images in 5 minutes. Out of those 100 images, 10 is very close to what I exactly meant at professional concept artist level. So, in this case Stable Diffusion only working 10% of the time is fine. Future is already here, I’m already incorporating stable diffusion generated images to my professional work.
- tstrimple 4y agoWhat kind of GPU are you running this on? My 3080 seems to take about 30 seconds per image with 50 passes. I'm wondering if I'm missing out on some optimizations. Could just be the quality of Linux NVidia drivers.
- marcAKAmarc 4y agoThis doesn't strictly have to do with stable diffusion, but I really really hope that someone eventually creates a service that hosts live interfaces for all of the legacy image generation models. The turn around on these things is wild, and I worry that unique image generation techniques will become antiquated and forgotten.
- avg_dev 4y agoI am sorry, I could not parse your comment. Can you explain what it means in simple terms? Thanks.
- marcAKAmarc 4y agoSure. It is probably hard to parse because I do not have solid knowledge regarding image generation AI stuff. To restate my previous sentiment, I am quite attached to image generation with GPT-2, which is now legacy. Even though GPT-2 is not as advanced in many ways as more modern alternatives, I am artistically attached to its' shortcomings/artifacts. I really hope older image generation methods like gpt-2 remain available as a service to the general public.
- Angelore 4y agoIn case with SD, you can download every version yourself. The main code is in git (you can go back to any point), and weights are versioned, I have every version saved, for example.
- lurquer 4y agoThe underlying data, I gather, must associate an image with a description. There aren’t millions of well-written descriptions of images. Yet, they’ve accomplished this with, I think, with merely the sparse text that comprises the title of the scraped JPEG or perhaps the surrounding text on a website. However, shortly, there will be millions of extremely detailed descriptions of new images… that is, a person puts in a detailed prompt, and if you can capture how pleased the user is with the result, you could then add that new picture — along with the user’s prompt — to your training data. Eventually, you will have millions of well-described images, which will make the system even more amazing.
- bhewes 4y agoThis is really fun with surrealist and imagist poetry. Endless for with Will Alexander's poems.
- jdthedisciple 4y agoHah! I uploaded a drawn picture of a bridge over cliffs and a river using the prompt "view of bridge over cliffs and river". What I got was "NSFW content detected, please try a different prompt". I must say it didn't exactly exceed my expectations.
- itronitron 4y agoThe author mentions a video demo of a Photoshop plugin being developed "which has to be seen to be believed" and then links to this video: https://www.reddit.com/r/StableDiffusion/comments/wys3w5/applying_img2img_to_video_3d_aladdin/ https://www.reddit.com/r/StableDiffusion/comments/wys3w5/app... ...but it seems to just be a copy of this scene from Aladdin: https://www.youtube.com/watch?v=inzkJ34VMfk&t=20s https://www.youtube.com/watch?v=inzkJ34VMfk&t=20s Am I missing something?
- mzs 4y agohttps://www.reddit.com/r/StableDiffusion/comments/wys3w5/comment/im0gyzx/ https://www.reddit.com/r/StableDiffusion/comments/wys3w5/com...
- ano88888 4y agoOpenAI is such a joke now compared to Stable Diffusion. Shame on them.
- deleted 4y ago[deleted]