8 ms·
I love how much work went into this. There's a great deal of pushback against AI art from the wider online art community at the moment, a lot of which is motiv
by simonw 4y ago
I love how much work went into this.
There's a great deal of pushback against AI art from the wider online art community at the moment, a lot of which is motivated by a sense of unfairness: if you're not going to put in the time and effort, why do you deserve to create such high equality imagery?
(I do not share this opinion myself, but it's something I've seen a lot)
This is another great counter-example showing how much work it takes to get the best, deliberate results out of these tools.
- minimaxir 4y agoUnfortunately it's become a meme among AI art haters that AI art is "just inputing text into a text box" despite the fact that is far from the truth, particularly if you want to get specific results as this blog post demonstrates. Some modern AI art workflows often require more effort than actually illustrating using conventional media. And this blog post doesn't even get into ControlNet.
- tester457 4y agoIt's a meme because 99% of the ai art creators don't go that deep, they only prompt. Even if they did have a more complex workflow most of them are still based on copyrighted training data, so there will be many lawsuits.
- capableweb 4y ago> Some modern AI art workflows often require more effort than actually illustrating using conventional media. And this blog post doesn't even get into ControlNet. Indeed. Another criticism that I can definitely somewhat see the idea behind, is that the barrier to entry is very different from for example drawing. To draw, you need a pen and a paper, and you can basically start. To start with Stable Diffusion et al, you need either A) paid access to a service, B) money to purchase moderately powerful hardware or C) money to rent moderately powerful hardware. One way or another, if you want to practice AI generated art, you need more money than what a pen and paper cost.
- realusername 4y agoStable Diffusion doesn't really need powerful hardware, any graphic card will do, it will just be a bit longer. There's even ports on smartphones nowadays.
- simonw 4y agoThere are plenty of traditional art mediums that require significant financial outlays to get started: oil painting, ceramics, glass blowing etc. There are plenty of free online tools for using all kinds of AI image generation techniques, and they don't require powerful hardware, just something that can browse websites or run Discord.
- adamm255 4y agoPlus training, lessons and inspiration. And talent. It’s like with dreams. They can be terribly intricate and detailed, but ask me to draw something creative and I’m out.
- wincy 4y agoI've probably spent at least an hour a day working in Stable Diffusion and Automatic1111 since January or so. At this point I'd call it my hobby, as instead of playing video games I'm plowing time into this. And I'm definitely seeing marked improvements in my style and what I'm looking for. I'll often start with a shotgun approach and make 64-128 pictures with a basic prompt of what I'm looking for. Sometimes there's a shape and basic composition that makes me gasp it's so much better than the others. So I'll feed that into img2img or inpainting, iterate on it, tweak settings that I just sort of have an intuitive feel for what turning the knobs does, and while away for an hour or two to make it exactly what I want. There's definitely a "dreamy fantasy art style" I'm a big fan of that would have cost me an absolute fortune to commission even one image a year ago. I can't match what is coming from the top artists on Artstation (I tried a few weeks back which was humbling, some astounding work). But it's good enough that my D&D buddies are entertained and amazed that I went through and made each one of their characters. Our DM, being someone who has released creative works, was reticent and less gung-ho on AI for awhile until he decided to start playing with the AI tools (Midjourney in his case) for a new custom campaign he's running. He's suddenly able to develop novel NPC tokens for every important character we meet, the monsters are high resolution and the convenience of using Midjourney in Discord (which he already uses to coordinate our online D&D games) has been a huge boon and enhancement to how much fun and immersive our games are. A year ago this would have cost literally tens of thousands of dollars. He's a published fantasy author so prompting aka describing a scene comes naturally to him. It's been a lot of fun seeing what he's coming up with. I'm really loving the spark of creativity I've been finding in myself where the turnaround on the old tools was too long for me to not get frustrated and give up, and to see it amongst my friends, even the ones who were initially skeptical.
- squidsoup 4y agoOnly if you exclude the countless hours an illustrator has spent developing their craft.
- yieldcrv 4y agobeing sympathetic to that requires pretending that the user would have ever commissioned an artist for that idea at all. both the transaction and the idea would have simply never happened. it was never valuable enough or important enough to commission a human, hope you got the correct human, wait week after week for revision after revision. people that want to hone a niche discipline for themselves still can do that. just be honest about doing it for yourself.
- libraryatnight 4y agoUsing AI as a tool to create art takes nothing away from anyone who spent time learning a skill or craft that they use in their own pursuit of expression. People will be arguing about whether or not art made with AI is art, and artists will just be using it or not. I remember an interview about electronic music where Bjork addressed concerns that if you use a computer to make music, it has no soul, and she said if the person using the machine to make the music puts soul into it, it will have a soul. I remember David Bowie in the mid 90s saying if he was young in that decade he might not have been a musician, because in the 60s being a musician seemed subversive and at the time of the interview the internet was carrying the flag of subversion. Anyway, it's interesting to watch these conversations. I'd never claim to know what art is or try to tell someone, but it seems to me that already because of the controversy artists are drawn to AI and further exciting the conversation. Commercial artists seem the most threatened; animators, designers, etc. I understand why, but I don't think arguing that AI isn't "art" is going to help their cause any more than protesting digital painting wasn't art, electronic music wasn't art, and much earlier that photography wasn't art. All the time these conversations are happening, the art's getting made and we're barreling towards the next 'not art' movement.
- jachee 4y ago> Using AI as a tool to create art takes nothing away from anyone who spent time learning a skill or craft that they use in their own pursuit of expression. Except all those artists’ art being used without their consent to train these models that subvert the exclusivity of their style, or obviate their work altogether. It ingests their literal effort and eliminates other humans’ need to put forth a similar level of effort. I’m all for cool new tools, but this is very much like the invention of digital sampling, and models should be required to “clear” all the works that they “sample” for training.
- dorkwood 4y ago> Some modern AI art workflows often require more effort than actually illustrating using conventional media. Then why don’t they illustrate it instead, and save themselves some time?
- efreak 4y agoWhy don't you buy your cake and cookies at a bakery instead of making them yourself at home?
- dorkwood 4y agoI’m not sure I understand your argument. If you’re suggesting that illustrating by hand requires more effort than automatically generating an image with AI, then we agree with each other.
- mdp2021 4y agoThe shruggingface submission is very interesting and very instructive. Nonetheless, it would be odd and a weak argument to point criticism towards not spending adequate «time and effort» (as if it made sense to renounce tools and work through unnecessary fatigue and wasting time). More proper criticism could be in the direction of "you can produce pleasing graphics but you may not know what you are doing". This said, I'd say that Stable Diffusion is a milestone of a tool, incredible to have (though difficult to control). I'd also say that the results of the latest Midjourney (though quite resistant to control) are at "speechless" level. (Noting in case some had not yet checked.)
- Paul-Craft 4y ago> More proper criticism could be in the direction of "you can produce pleasing graphics but you may not know what you are doing". I don't get this. If one "can produce pleasing graphics," how does that not equal knowing what they're doing? I only see this as being true in the sense of "Sure, you can get places quickly in a car, but you don't really know how it works."
- mdp2021 4y ago> how does that not equal knowing what they're doing The goal may not be to produce something pleasant. The artist will want some degree of artistic value; the communicator will want a high degree of effectiveness etc. The professional will implicitly decide a large number of details, in a supposedly consistent idea of the full aim. The non professional armed with some generative AI tool may on the contrary leave a lot to randomness - and obtain a "pleasant" result, but without real involvement, without being the real author nor, largely, the actual director.
- bawolff 4y agoThat seems untrue. In this case, the author set out with a specific goal, then tried to do it, and then succeded. What are you suggesting, that the author lied in the blog post and actually worked backwards, post hoc? Seems incredibly unlikely based on the details they wrote.
- asddubs 4y agomost of the criticism I've seen is that it's all trained on uncompensated stolen artwork. Much like how copilot is trained on GPL code, disregarding its license terms.
- simonw 4y agoThe trained on stolen artwork critique is reasonable - I helped with one of the first big investigations into how that training data worked when Stable Diffusion first came out: https://simonwillison.net/2022/Sep/5/laion-aesthetics-weeknotes/ https://simonwillison.net/2022/Sep/5/laion-aesthetics-weekno... It's interesting to ask people who are concerned about the training data what they think of Adobe Firefly, which is strictly trained on correctly licensed data. I'm under the impression that DALL-E itself used licensed data as well. I find some people are comfortable with that, but others will switch to different concerns - which indicates to me that they're actually more offended by the idea of AI-generated art than the specific implementation details of how it was trained.
- bugglebeetle 4y agoI think the more correct argument is that Stable Diffusion effectively did a Napster to force artists into shit licensing deals with large players who can handle the rights management. It’s unlikely that artists would’ve ever agreed to them otherwise, but since the alternative now is to have your work duplicated by a pirate model or legally gray service, what are you going to do? This seems borne out by the fact that Stability AI themselves are now retreating behind Amazon for protection.
- adamm255 4y agoWhen I did Photography at college, a lot of the work was looking at other works of art. I spent a lot of time in Google Images, diving through books from the Art section and going to galleries. Lots of photo copying was involved! I then did works in the style of what I’d researched. I trained myself on works I didn’t own, and then produced my own. I kind of see the AI training as similar work, just done programmatically vs physically. Certainly a very interesting topic. I can’t get my head around how far we’ve come on this in the last 6-12 months. From pretty awful outputs to works winning Photography awards. And prints of a dog called Queso you’d have paid a lot of money to an illustrator for.
- brucethemoose2 4y agoTBH it would be much easier with more streamlined tooling, especially if doing it locally with lora/lycoris. Its kinda like using ffmpeg for vapoursynth for video editing instead of a video editing GUI. That being said the training parameter/data tuning is definitely an art, as is the prompting.
- quadcore 4y agoa lot of which is motivated by a sense of unfairness Say you generate a picture with midjourney - who is/are the closest artist(s) you can find for that picture? Not the AI, not the prompter, so the closest artists you can find for that picture are the ones who made the pictures in the training set. So generating a picture is outright copyright infringement. Nothing to do with unfairness in the sense of "artists get out compete". Artists dont get out compete - they are stolen.
- ModernMech 4y agoTypical Midjourney workflow involves constantly reprompting and fine tuning based on examples and input images. When you arrive at a given image in Midjourney, it’s often impossible to recreate it even with the same seed. You’ll need the input image as well, and the input image is often the result of a long creative process. Why is it you discount the creative input of the user? Are they not doing work by guiding the agent? Don’t their choices of prompt, input image, and the refinement of subsequent generated images represent a creative process?
- quadcore 4y agoI agree with you on the technicality - if we say the promter is an artist, then the picture belongs to him.
- quadcore 4y agoFrom what I read on the internet, people assume AI generated art is a difficult question legaly speaking. Some literally assume artists complain only because there are out competed. I disagree - I think that AI generative art is an easy case of copyright infrigement and an easy win for a bunch of good lawyers. That's because you can't find an artist for a generated picture other than the ones in the training set. If you can't find a new artist, then the picture belongs to the old ones, so to speak. I really dont see what's difficult with that case. I think the internet assume a bit to quickly it's a difficult question and a grey area when maybe it just isnt. It's noteworthy that Adobe did things differently than the others and the way they did things goes in the direction im describing here. Maybe it's just confirmation bias.
- circuit10 4y agoIt’s not as simple as that though because the algorithm does learn by itself and mostly just uses the training data to score itself against, it doesn’t directly copy it as some people seem to think. It can end up learning to copy things if it sees them enough times though “you can't find an artist for a generated picture other than the ones in the training set. If you can't find a new artist, then the picture belongs to the old ones, so to speak” I don’t think that’s valid on its own as a way to completely discount considering how directly it’s using the data. As an extreme example, what if I averaged all the colours in the training data together and used the resulting colour as the seed for some randomly generated fractal or something? You could apply the same arguments - there is no artist except the original ones in the training set - and yet I don’t think any reasonable person would say that the result obviously belongs to every single copyright owner from the training set
- ModernMech 4y agoBut this person’s dog isn’t in the training set, so why should some artist be credited for a picture they never drew? Not a single person has drawn his dog before, now there is a drawing of his dog, and you want to credit someone who had no input to the creative process here?
- quadcore 4y ago
- basisword 4y ago> if you're not going to put in the time and effort, why do you deserve to create such high equality imagery? This isn’t high quality imagery. Don’t get me wrong, the tech is cool and I love the work that’s went into making this picture. But this isn’t something I would ever hang on my wall. There’s probably a market for it, but I get the strong impression it’s the “live, laugh, love” market. The people that buy pictures for their wall in the supermarket. The kind of people who pay individual artists money to paint bespoke images of their pet are not going to frame AI art. I don’t think the artists need to worry.
- yellow_postit 4y agoI would expect it’s only a matter of time till those “traditional” artists also adopt these tools into their workflows. Similar to the initial pushback against the “digital darkroom” which is now the mainstay of photography. In-ai-aided art, like manually developed film, will trend towards a niche.
- theaiquestion 4y ago> This isn’t high quality imagery. Don’t get me wrong, the tech is cool and I love the work that’s went into making this picture. But this isn’t something I would ever hang on my wall. Well yeah but that doesn't change the OP commenter's point that it takes a lot of work to get high quality art still. > I don’t think the artists need to worry. I disagree here but only on the basis of what type of art it is. Stock art/photography, and a lot of media designwork is likely at risk because we can now create "good enough" art at the click of a button for almost no cost. I agree that the "hang on the wall level good" artists aren't at risk just yet, but between the more filler-art and the uh Well "anime/furry" commissioners are definitely at risk right now for anything except the highest quality artists, and there is a MASSIVE community behind this - in fact they have done a lot of the innovation for StableDiffusion including optimizations/A1111 webui, and have trained many custom models for their art, already had pretagged datasets of 10k's of images....
- syntheweave 4y agoSimpler cartooning styles like classical Disney/Warner are actually some of the weakest ones in AI models right now. Prompted diffusion models are poorly suited to the task and tend to capture excess detail in the contour, because they don't have a mechanism for calculating out the geometry of a constructed form, so they don't arrive at the same clarity and simplicity. What the model can do best is to convert a basic contour sketch into an elaborate rendering, which means that it's the top end of the market that was doing those renderings that's most at risk.
- davely 4y agoI love the detailed workflow that OP posted. Dogs seem to be particularly good subject material for this. I turned my dog into a robot awhile back using the img2img feature of Stable Diffusion and the results were pretty amazing![1] [1] https://twitter.com/davely/status/1583233180177297408 https://twitter.com/davely/status/1583233180177297408
- madeofpalk 4y ago> a lot of which is motivated by a sense of unfairness This is not something I've seen once in any sort of criticism of "AI art", and elsewhere in the internet I'm largely in a anti-ai-art bubble. Most legitimate pushback I've seen has been more on the non-consensual training of models. Many artists don't want their work to be sucked up into the "AI Borg Model" and then regurgitated by someone else, removing the artists consent, credit, and compensation.
- regularfry 4y agoI absolutely have seen it. A lot. It's dressed up as Luddism, more often expressed as "you shouldn't be able to have those results because I spent years honing my craft" which may or may not be followed by "...and if we allow this, those years were wasted and I'm out of a job, along with millions of others".
- TeMPOraL 4y ago> It's dressed up as Luddism > "...and if we allow this, those years were wasted and I'm out of a job, along with millions of others" Given that the quoted part is highly likely to happen, and not just in art, I hope we're no longer considering "luddism" to be a pejorative.
- bawolff 4y agoLuddites were a real group, who really did lose their jobs to technical progress. So it seems fair. Technical progress does really require adaption sometimes. We don't criticize luddites because we think they were wrong about change being a real thing.
- odessacubbage 4y ago[flagged]
- jhbadger 4y ago