21 ms·
Don't fire your illustrator
- seeknotfind 3y agoYeah, you can create stuff, but the work to do editorial review or clean up is still huge.
- asutekku 3y agoAnd editioral review would not be huge work on generative art?
- seeknotfind 3y agoIt's about the details. You need to iterate a lot or fix pieces to get a cohesive whole.
- deleted 3y ago[deleted]
- justrealist 3y agoThese posts are all written with this insane premise that the moment in time the post was published, will continue to be the status quo for more than a couple months. > If you’ve ever used a generative system, I can pretty much guarantee that you spent an embarrassing amount of time making tiny adjustments to your prompt and retrying. Producing a compelling image with generative AI is pretty easy; maybe one in ten images it generates will make you say, “Wow, cool!” But producing a specific image with generative AI is sometimes almost impossible. Who could possibly think this will be the case six months from now? I mean, maybe some of the the content and warnings here is fleetingly accurate, but it's truly not a hill to die on. You could fire your illustrator and be inconvenienced for a couple months until the next stablediffusion update. It's a disservice to illustrators to make them feel safe.
- seabass-labrax 3y ago> It's a disservice to illustrators to make them feel safe. It is also a disservice to encourage managers to make their illustrators redundant when we don't yet know that, in six months, AI image generators will equal a human illustrator in being able to create adequate pictures. This kind of article has an important role, namely that of countering hype (often based on PR from machine learning companies). That hype is why more ignorant people think that AI can already replace crowds of employees, when the reality is more nuanced.
- jefftk 3y agoI'd bet on this being true six months from now. DALL-E 2 came out in 2021-01 (19mo ago) and Midjourney in 2022-07 (13mo ago). While the quality of images has improved a lot, if you have something specific and moderately complex in mind it's still very hard to get there just from a textual prompt.
- raincole 3y agoBut the tech did improve a lot in the past year. One year ago we had textual inversion. Now we have LoRA and control net. I know it might not be a scientific breakthrough, but in practice it's day and night.
- jefftk 3y agoI'd be happy to bet that the tech will continue to improve. But "producing a specific image with generative AI is sometimes almost impossible" seems very likely to still be true in February 2024.
- raincole 3y agoDepending on your definition of "specific". Of course an AI can not produce an image that matches what's on your mind 100%. Because by definition it will require you to provide all the information, a.k.a. you need to make the image by yourself first. But I really don't think illustrators are as safe as the article implies. Yes, the jobs won't disappear overnight, but are there that much demands for illustration to support a future where every illustrator becomes 10x more productive than before? (I've done illustration commercially before, while it's not my main source of income and I'm junior level at best.)
- orbital-decay 3y agoPosts like that nearly always assume the text-to-image and "prompt engineering" being used, usually due to the lack of experience with those models. This is categorically not the way to do it outside of having fun. The way it's done for predictability and control looks much more like "draw the rest of the owl, in a manner similar to my other hand-drawn owl" combined with photobashing and manual fixing/compositing. It's a hybrid area similar to 3D CGI that requires both artistic and technical skills if you want to create something non-boring. This has nothing to do with the model's poor understanding of natural language, and will not change until we have something that could reasonably pass for AGI, and likely not even then. Your text prompts simply don't have enough semantic capacity.
- jefftk 3y agoYou might be interested in the "Commercial illustrators will keep their jobs, but will mostly need to learn to use AI as a part of their workflow to maintain a higher pace of work" section of the article, which gets into this more.
- orbital-decay 3y agoYou're right! I've stumbled upon the prompt engineering part and rolled my eyes, which was clearly too soon.
- makeitdouble 3y agoThe more plausible evolution is that people drawing the base concept are not "commercial illustrators" nor have art training. If a magazine editor with run of the mill drawing skill can feed the prompt a sketch with stick figures and object outlines, and get back a good enough rendition with an improved composition, the job of the illustrator will be a side job of that editor. I'm partial to the argument that being able to fix the generated image in post is a valuable skill, but on that part we already have decades of progress and people are usually more comfortable with editing tools than drawing tools.
- florbo 3y agoThe post actually goes into a bit of detail on that process.
- thebooktocome 3y agoAuthor conflates legal and ethical options for preventing copyrighted work from being used to train ML image generators. There’s nothing legally inconsistent about passing a law saying, e.g., “ML training is not fair use”. Doing so will not even reduce existing fair use rights being exercised by actual people. The author’s argument is that doing so is philosophically analogous to human creative processes, but those are—and I can’t underline this enough—human. And the law is not (and cannot be, should not be?) consistent in such a way.
- Jevon23 3y agoPeople in the US forget that passing new laws is even an option because Congress is dysfunctional.
- msla 3y ago> There’s nothing legally inconsistent about passing a law saying, e.g., “ML training is not fair use”. Is it still fair use to take inspiration from another artist's work? How can the courts necessarily tell if the art was made using AI or if it's just someone stealing another artist's style? Theft of style isn't currently recognized under the law, but it could be.
- thebooktocome 3y ago1. Yes. Always has been, within the ambiguous limits of fair use. 2. Discovery. https://www.americanbar.org/groups/public_education/resources/law_related_education_network/how_courts_work/discovery/ https://www.americanbar.org/groups/public_education/resource... Some variants of “theft of style” are recognized by some courts already, please see the legal literature on music copyright and the recent 7-2 SCOTUS decision on Warhol’s Prince series.
- diiq 3y agoI absolutely agree that an arbitrary line can be drawn; I don't see that that line can be clear and bright enough that forms the kind of precedence that can be relied upon by folks who don't have the money to fight an uncertain battle in court. But would be overjoyed to be proven wrong.
- raincole 3y agoI'm more interested in how this "cross attention" part works. Being able to combine two different kinds of AI sounds too good to be true. It sounds like AGI. Why does it work for SD? Why aren't we trying to combine more AIs to create a super AI? Or we're already doing this?
- samsartor 3y agoCross attention is not really a way to "combine multiple AI models" but there are many ways to do that, and actually diffusion models are really good at being combined with stuff. Especially thanks to tricks like score distillation (see dreamfusion3d.github.io). But it isn't anything like AGI because the AI is not inventing the combinations itself, and even if you could, there is no clear way to make it self-directed. These are still processes that require lots of programmers being very clever. Edit: typo
- RugnirViking 3y agoI agree with most of this, but I do disgree with the thing about producing specific imagery. It's absolubtely a skill one can develop. I spend a lot of time helping people leearn to simplify their prompts and choose the right language for image generation AIs. For some reason people put a lot of unnessacary junk into them, I guess a form of superstition (this sentence fragment worked well the last few times). As the article mentions, the hybrid approach (using this as a tool in a series of other tools) is the way forward There are concepts the AI simply will not grasp. For example right now midjourney will extremely struggle with "bulldozer", "centaur", "fantasy archer" etc. These will inevitably fixed (and have in the past) be fixed with new model versions with better training data. The real struggle comes with either small details or semantic information. For example, its hard to ask it to make a lifelike/photograph scene with everything including the background in focus. Even with "focus stacking" type keywords. "selfie" is about the best word we came up with but unforunately that has significant side effects lol. Perhaps there just isnt enough instances of people specifically describing that property in the training data, but honestly its difficult to even learn english words for these concepts to describe with! As for small details, it is indeed true that the current approach will probably never scale to handle something like "six blue cubes with a red triangle on each, arranged in a pyramid shape, with a yellow ball balanced on top". But as the author points out, such things will likely be handled with a minimum of photoshop skill using assets made individually
- noduerme 3y agoNone of which has anything to do with creativity or the original (and visually trained) thought required to conceive of imagery that's commercially useful - which is an actual skill learned through years of study and experience, and which is so routinely ignored by managers and IT people that you completely failed to mention it in your take on the technical issues with prompts. The issue with prompts is not stacked cubes. It's more like this: Ask 10 software engineers or 10 people from the sales department or 3 people from upper management to come up with visual ideas for ads, and you will have a bunch of shit on black backgrounds, robots, anime, bad copies of things people have seen and subconsciously remember, and zero actual visual ideas that fundamentally work. Designers and illustrators have to fight against and override their unoriginality and terrible ideas all the fucking time just to make a decent product.
- grncdr 3y agoCompletely off-topic, but if the author happens to be here: What is the system you are using to justify text? The "hanging" parenthesis on "(Understand that what I'm about to describe, ..." caught my eye, and it appears that every _line_ of text has it's own padding and word spacing to arrange it "just so". I can't imagine it was done by hand, but I've never seen it before.
- Q6T46nT668w6i3m 3y agoI didn’t look at the code but it looks like they are using the Knuth-Plass algorithm.
- zauguin 3y agoThe site uses [unjustifiable] together with [Hypher]. [unjustifiable]: https://www.npmjs.com/package/unjustifiable?activeTab=readme https://www.npmjs.com/package/unjustifiable?activeTab=readme [Hypher]: https://github.com/bramstein/hypher https://github.com/bramstein/hypher
- diiq 3y agoAuthor here! As noted in another reply, I'm using a custom justification tool I built almost a decade ago called unjustifiable. The way it goes about it very silly; you can read more about it at https://sambleckley.com/writing/text-justification.html https://sambleckley.com/writing/text-justification.html
- choppaface 3y agoI wish the article quantified the amount of SEO and ‘irrelevant’ content procured in the wild—- it’s a large number but also a dark art for creators to produce cheaply. The author seems somewhat content with the idea of using AI to generate garbage content, but this essay might underestimate the profits of leveraging existing art to train said AI. It strikes me in the current Writer’s Strike, studios probably have an estimate of how profitable AI could be and aren’t sharing that number. The essay focuses mainly on prompt-slot-machine-based generative AI but there’s a large suite of work that uses the same research to more directly support the artist. Stuff like in-painting, controlled diffusion, and re-stylizing.. as long as it’s free (compared to more expensive art equipment) it should have a beneficial impact on artists.
- samsartor 3y agoOverall this post is a pretty fair take, but I'm not sure intuitive the "latent space" explanation is. I work with diffusion models full time and really appreciate how easy they are to explain at an introductory level (assuming you don't get distracted by the mathematical derivations). But I don't feel like I've seen that many good explanations online. I made my own attempt in a presentation last year (https://youtu.be/c-eIa8QuB24?t=86 https://youtu.be/c-eIa8QuB24?t=86) but haven't had time to clean it up. I keep hoping I'll see a better series from a real communicator pop up in my feed but I'm not sure this is it.
- catgary 3y agoHonestly, as a mathematician-turned-ml-researcher, Song and Ermon’s mathematical derivations based on SDEs are what sold me on diffusion/score-based generative models. This (https://youtu.be/wMmqCMwuM2Q?si=fvujznGDHjKH2yUi https://youtu.be/wMmqCMwuM2Q?si=fvujznGDHjKH2yUi) is probably the best ML seminar talk I’ve ever seen.
- samsartor 3y agoOh definitely. I think that 2021 paper was what sold me as well! But I don't think it is very approachable to non-technical audiences, and there are a number of other was to interpret diffusion models which are pretty intuitive. That is also why I like the alpha-(de)blending paper from this year.
- thelazyone 3y agoWell put. Big fan of the "Commercial illustrators will keep their jobs, but will mostly need to learn to use AI as a part of their workflow to maintain a higher pace of work" part. I'm a sometimes-illustrator (but my style is pretty far from what Generative AI is doing), and I recently published a 1.1 of a game manual which uses Midjourney images. I'm currently investing in a "proper" illustrator because the MDJ images lack character, but it's also true that in a few months from now this might change: I'll stick with the illustrator to have more consistency in the images, but probably the AI could do a fancier job there. Besides, the "things will change in 2 months" point is a good one, but it's been used since a year and a half and things haven't changed yet. Sure, the quality of the produced images improved, but not in a qualitative scale. Side note: the link civitai to leads to https://sambleckley.com/writing/civitai.com/images https://sambleckley.com/writing/civitai.com/images which is a dead link.
- atleastoptimal 3y agoThe question is, since commercial illustrators can be more efficient using AI, will the total number of jobs in the space lower, or will the expectation for commercial illustration increase, thus increasing the workload and keeping the number of jobs the same.
- satvikpendem 3y agoIn all of human history, work has always increased. This is akin to Parkinson's Law, where work expands to fill the time (and now resources) available.
- atleastoptimal 3y agoWork has always increased, but work in a specific profession doesn't necessarily increase. There are certainly fewer phone switchboard operators today than there were 100 years ago.
- satvikpendem 3y ago
- arvidkahl 3y agoIve tried letting AI write my articles. It was horrible. I tried ignoring AI-powered tools (such as grammar checkers, summarizers, rewriters, speech-to-text apps), and the writing process felt sluggish. The middle ground is what works best for me. I use generative AI exlusively mid-process, but neither for input (ideas) nor output (actual drafts.) Here's how I write: - I source my ideas from contemplation or conversations on social media. Topics discussed there have at least some pre-validated relevance - I sit down for ten minutes and dictate my thoughts into a tool like AudioPen (no affiliation, just a fan) which summarizes my 10 minutes in 5 or 6 paragraphs. THIS is the AI step. The tool suggests a few paragraph structures that I cycle through until I find a good one. - From there, I write my draft, following that outline. No more AI tools here other than grammar checking at the end. AI is a great writing partner. It's a horrible writer.
- earthboundkid 3y agoThat’s been my experience so far too. It’s good for giving you some suggestions for things to structure and things you may have missed, but it is a terrible writer ATM.
- pizzaknife 3y agoSam, your character arc reads similar to my own. Thanks for putting yourself and your experience (and emotion) into this write up. It gives me peace of mind to know others share both the haphazard education -> career lineage and the existential concerns which maybe are part and parcel with said lineage. FWIW, I was a budding pen and ink illustrator when "desktop publishing" was tipping past "expensive novelty." Love the write up - thank you again, sincerely.
- aaroninsf 3y agoEvergreen: Ximm's Law: every critique of AI assumes to some degree that contemporary implementations will not, or cannot, be improved upon. Lemma: any statement about AI which uses the word "never" to preclude some feature from future realization is false. As the Magic Eightball says, ask again later.
- nottorp 3y ago> Ximm's Law: every critique of AI assumes to some degree that contemporary implementations will not, or cannot, be improved upon. https://en.wikipedia.org/wiki/AI_winter https://en.wikipedia.org/wiki/AI_winter I wonder why...
- jononor 3y agoWhat are you saying? That those that claim critical improvements won't happen are well justified? Or that they are not and just stuck in the 90ies? Or that a hype cycle will happen, but massive impact on trades/jobs will still be had? Or something else?
- joshstrange 3y ago> Finally, an opinion popular with no one: Commercial illustrators will keep their jobs, but will mostly need to learn to use AI as a part of their workflow to maintain a higher pace of work. > This doesn’t mean illustrators will stop drawing and become prompt engineers. That will waste an immense amount of training and gain very little. Instead, I foresee illustrators concentrating even more on capturing the core features of an image, letting generative AI fill in details, and then correcting those details as necessary. I'm not sure why they think this is unpopular with no one. This seems like the logical path forward. In the same way that CoPilot isn't going to replace me but it's makes certain boilerplate much less painful and avoids the "blank page"/"writers lock" that can happen when I go to write a function sometimes. It's just nicer to start from something then modify it until I have what I need (even if I end up replacing 80-99% of it). In the same way I imagine it would be nice for an artist to see a couple of examples of what their line drawing could be which will spark some creativity and then they can do what they want.
- simonw 3y agoRight, that opinion is popular with me: I love the idea that commercial illustrators can add generative AI to their toolbox. Those are the illustrators I most want to work with: people who can produce the best possible images using the whole suite of tools available to them.
- satvikpendem 3y ago> Commercial illustrators will keep their jobs, but will mostly need to learn to use AI as a part of their workflow to maintain a higher pace of work. This is exactly what I've found to be the case too. People outside of this AI media generation community still think it's entering some text and getting some output. In reality, there are entire workflows constructed to get the exact type of image one wants. Look at: https://old.reddit.com/r/StableDiffusion/comments/14ye2eg/comfyui_seargesdxl_wooow/ https://old.reddit.com/r/StableDiffusion/comments/14ye2eg/co... The second image is the output image, but the first is even more interesting. It is a node based interface more commonly seen in game development tools like Unreal Engine which has a similar interface [0]. It is akin to hooking up APIs together to get the resultant image. I see the future of image generation being more akin to backend programming than actually drawing anything, which is to be expected as the actual drawing part is getting automated while the creativity now rests in the workflow itself (at least until we automate the workflow part too, but that's a far ways off as computers can't read minds yet to even know what the user wants). [0] https://docs.unrealengine.com/5.2/en-US/nodes-in-unreal-engine/ https://docs.unrealengine.com/5.2/en-US/nodes-in-unreal-engi...
- canvascritic 3y agoMy partner and I run a handful of small internet side businesses. One of our content-driven D2C businesses heavily relied on bespoke illustrations for our display ad creatives. we found that our ctr was decent, pretty average, but the CPC was killing us and ROAS really sucked. Several months ago we decided to A/B test SD against our usual illustrators. In our case the results were pretty dramatic, we actually found that the ctr shot up by almost 20% and cvr showed a consistent uptick. I don't agree with the blog post's claim that AI generated images work best in businesses where the content doesn't actually matter; this particular venture is a fantastic counter example. In our case the AI-generated images seemed to resonate more with our target audience, as we were able to achieve much more granular personalization at lower cost than before. not only did it reduce the CPA significantly, but the tight control we had over creative variations meant we could optimize in realtime based on audience segmentation. Not to mention that our time-to-market for launching new campaigns went down by half. no more back-and-forths over design nuances, missed deadlines, or creative blocks. And I do feel a bit mixed about the diminishing role of human touch in creative processes. But from a purely growth-hacking POV, this was a gamechanger, and we have the numbers to prove it. Overall I think this is a net win, especially because I don't think this needs to be the end of the road for human illustrators, but this will force them to adapt and bring more sensitivity to the needs of their clients. It makes no sense for even a content business to be subject to so much friction in the procurement of creatives, and this forces more consideration to our needs Anywho there's efficiency, and then there's soul. Hats off to the robots for (mostly) nailing the former, and sometimes surprising with the latter.
- satvikpendem 3y agoWhat is your type of business and what kinds of images did you generate? Curious as I was thinking of doing something similar for mine.
- thebooktocome 3y ago> Overall I think this is a net win, especially because I don't think this needs to be the end of the road for human illustrators, but this will force them to adapt and bring more sensitivity to the needs of their clients. The advantages of AI that you crow over simply can’t be met by any human professional artist. A human can’t do hundreds of revisions profitably. There’s increased “sensitivity” and then there’s needing to read the client’s mind. If you think this isn’t a death knell for human illustrators in this particular market, you’re deluding yourself.
- woolion 3y agoI used to think that the generative AI impact would be pretty low because these images always have some artifacts that I find pretty jarring, and that require fairly high artistic skills to fix. However that was completely wrong: most people don't care! Neither people producing the content, nor the people consuming it. The second point, "only spammy garbage content" will be happy with AI generated content, is already proved wrong given the quantity of high profile blogs that rely on it. They don't have the budget for the maybe 5% improvement you can get by paying an artist, and 0 of the risks common with artists (difficult to work with, missing deadlines, etc etc). In a way it doesn't even make sense: the artist is also is also a generative blackbox. It's better in understanding precise prompts, but exactly as in software engineering the problem is often that the spec is wrong, the commissioner cannot get exactly the image they dream of because they cannot imagine it without having pretty high artistic skills. Or a number of iterations are needed, making the process quite long and costly. There are other reasons why artists won't be entirely replaced, especially the highest paid, but a good chunk of their potential income sources have already been wiped out, and the proportion will only increase.
- raincole 3y ago> I used to think that the generative AI impact would be pretty low because these images always have some artifacts that I find pretty jarring, and that require fairly high artistic skills to fix. However that was completely wrong: most people don't care! Neither people producing the content, nor the people consuming it. Sometimes I feel professional people are so good at their crafts that they're disconnected from general audiences. It's kinda like a programmer trying to convice a data scientist that Python is not that good of a programming language, while the data scientist is perfectly fine with it.
- bugglebeetle 3y agoMy takeaway from generative art as a former illustrator and now data scientist is never has it been more obvious why artistic skill and taste are necessary for making images, while at the same time never have those things been more irrelevant because of the audience for the work.
- mr_toad 3y ago
- Invictus0 3y ago> Producing a compelling image with generative AI is pretty easy; maybe one in ten images it generates will make you say, “Wow, cool!” But producing a specific image with generative AI is sometimes almost impossible. I think this is the meat of the argument and a pretty compelling point. I have definitely struggled to get mijourney to create certain images that I had in my head and eventually just gave up.
- easyThrowaway 3y agoAnother opinion popular with no one: AI will have on artists the same impact that Spotify had on the music industry that is, it will kill any revenue flow for anyone outside of the publishers and big artists/players. Spotify basically killed any money coming from the physical distribution - Worse than piracy, which was inevitable too at the time, but at least you didn't have to pay your lawyers to renegotiate with your label on top of NOT getting any money. Adobe, OpenAI, whatever: they want artists to draw for them for peanuts to train their model, sign a waiver saying "I'm ok not getting any money from any AI art made from this", and then resell the output for $$$ on something like Splice[1], at the same time overtraining such models in ways that make extremely obvious whose artist made them in first place. At the end of the day the model itself is going to be basically irrelevant, while knowing whose works were actually used to train it being the truly differentiating feature. But you know, "the AI did this picture, so we don't have to pay you." [1] https://splice.com/features/sounds https://splice.com/features/sounds
- easyThrowaway 3y agoAlso, if you're wondering "Well, I could get better terms for my art" - Like I said, when Spotify arrived and you were signed on a label you HAD to sign the part that said "Yes, you can put my music online on Spotify and I will get paid peanuts" or else, unless you were Madonna or Taylor Swift. Or, sure, you can also terminate your record deal. Hope you have 500 grands around just for that. Frankly I don't see it ending much better for visual artists.
- munk-a 3y agoThere was another path here - collective bargaining. When small individuals are bullied by large corporations it's because those corporations want something from the small individuals... they certainly don't care about one or two small artists walking away from the platform - but if artists can organize and bargain as a group they can ensure a fair outcome. I think the modern world has become too complacent in terms of labor organization - the time of plenty left a lot of people content to take whatever was given to them because there was such a glut of excess that it was freely shared. That sharing is coming to an end and we're returning to a time when we need to demand fair and equitable treatment.
- chankstein38 3y agoThis is almost exactly how I see GPT and code. I have seen smart people who don't write code toss GPT a request and get a working thing but going from "hey write me an auto presser for a key on a timer" to "The client wants you to update the repo to handle this business logic and do this functionality" is a huge leap. From my perspective, you still need a developer-minded person to do the job, AI just kind of makes their lives easier in the process. I agree with the sentiment that it's the same in the art world. It's easy to get a compelling image but to get specific meaningful images usually requires a lot of post processing that a layman wouldn't be capable of doing.
- ilaksh 3y agoTrue but I feel like people are assuming these limitations will be long term. But we have seen progress in leaps and bounds. LLM-based coding tools are getting better. LLMs are getting better. Context size is increasing. And the interest in LLMs is even motivating development of new approaches that will be more effective. Give it a few years, things like Lecun's JEPAs or whatever hybrid supercoder DeepMind is working on, or some open-source LLM, will blow GPT-4 out of the water for programming.
- chankstein38 3y agoI agree these things are going to move likely faster than we can imagine and become better than we can imagine. That said, last week I got a ticket that had no body but a title akin to "Add a property for this" with no specifications about the system. When I asked for clarity on the ticket the ask was very different than the title implied. When I started the work it started to look different than was described so I went back to the requestor and explained the discrepancy and we changed the direction of the change. I say this to say, one skillset I have as a developer is taking the vague requests product owners have and figuring out how to turn them into actionable code steps in a massive existing codebase with several repos. I don't say this to say I'm impossible to replace but to say that half the time people don't even know what they want or how to describe it. Then from there you have giant codebases that wouldn't fit in anything but the biggest (current) context windows. I agree the accuracy limitations will likely evaporate but these things aren't necessarily something an LLM can solve. I'm probably going to be proven wrong over time but I use GPT for code pretty regularly and right now I'm not too worried about my job.
- IKantRead 3y agoAI will only replace the work of creatives who have already turned themselves into AIs long ago. There are plenty of writers and illustrators out there who have trained themselves to churn out reproducible garbage over the years in order to fulfill the demands of content marketing. These jobs will be replaced by AI soon, but by creating content from a formula they've already be using a crude form of AI. I really love Stable Diffusion, but, as a means of creating art (including the most common forms of popular art), it can only supplement existing work not replace it. I pay for plenty of real art in my home and the best works on my walls could never be replicated by an AI because what makes them beautiful is precisely the human touches that I have yet to see AI generate (and suspect it can't). Latent Diffusion Models also have a pretty poor imagination. At the same time Stable Diffusion has gotten me thinking about creative projects I could undertake that would have been impossible years ago. But it's obvious that all of these projects will take plenty of work to create, and SD will ultimately just be another tool in the creative process. I vividly remember when photoshop started to gain major acceptance and there was a similar anti-photoshop sentiment among "real" designers and artists. What's funny is how many webcomic authors I see critiquing AI art, when I remember quite well pen and ink comic artist similarly scoffing at web artists that used digital tools to create their work. Hopefully we'll see SD and similar tools accepted as more tools to create cool art, rather than a misplaced focus of peoples career anxiety.
- ilaksh 3y agoWhat are the artist names and descriptions of the art? Would you care to share a few? I am curious as to whether your claim that they can't be reproduced by an SD model can be shown.
- Waterluvian 3y agoHas there always been this much debate/discussion any time a new technology disrupts an industry? Or is this a particularly unique case because it touches on what we perceive much more as "creative" works? When audio recording became a consumer product, was there huge resistance from live performers? I would imagine so, but I just don't know much on the subject.
- raincole 3y ago> huge resistance So far I'd consider the resistance from artists against AI "small" to "practically none". If artists go on street and demain copyright law changes then I'll say it's moderate amount of resistance. Luddites did smash down machines.
- Waterluvian 3y ago> Luddites did smash down machines. I feel like I barely knew this and now need to go read up on that whole era. Thanks!
- laddershoe 3y agoI can highly recommend an episode of 99% Invisible [1] about the musician's strike of 1942, which was a fight about royalties from recorded music, but was in large part actually about the the loss of livelihood from music recordings. Very little new music was recorded for over a year, and the president of the musician's union was pushing for record labels to pay into a fund that would benefit unemployed musicians in order to end the strike. I didn't make the connection when I heard this, but yeah, it does feel analogous to what we're facing now. [1] https://99percentinvisible.org/episode/one-year-the-day-the-music-stopped/ https://99percentinvisible.org/episode/one-year-the-day-the-...
- Pannoniae 3y agoActually, it was only instrumental musicians being prohibited to record. So singers weren't affected and that strike hugely contributed music shifting from primarily instrumental (earlier jazz, swing) to vocal-focused (jump blues, rock and roll and so on...) It's interesting because it's something which is around us every day but most of us don't know about it.:)
- 01100011 3y agoPost seems very biased towards the now. Stable diffusion et al are very successful with a certain technique but it is foolish to think that is a method which will simply be improved indefinitely. Generative "AI" will take many forms. Ultimately it will likely remove much of the "technique" element to creation, depriving artists and content owners of income and relevance. Will this happen overnight? No. I suspect over the next, say, decade, AI will be a beneficial tool more than a threat. At some point, I expect generative AI to become multi-sensory(sight, sound, touch). Such systems will work from physical models of subjects/environments to produce novel and accurate representations based on rich descriptions and deep contextual awareness of culture. These systems will not think in pixels but in objects and relationships which are then simulated, rendered and filtered to match the desires of the users. I do applaud efforts of the writers and actors to protect themselves from competition but I believe it will ultimately be in vain. It will be interesting to watch the legal developments in this space. It may be necessary for future generative systems to provide an audit trail showing how they gained an understanding of the world to prove no unauthorized training was performed. This merely raises the bar slightly and does not prevent future generative systems from deriving important relationships via other means, such as 'clean room', high-level descriptions being given(perhaps by other automated processes). For example, while it may be illegal to train an AI to reproduce Harrison Ford using his copyrighted works or even images captured in a public space, I can reduce Harrison Ford to a set of characteristics which can be passed to a generative system to produce something indistinguishable from the real Harrison Ford. If I am able to document this procedure I see few ways for the legal system to prevent it but then again I am no expert in this area. For what it's worth, I'm not a fan of current "AI". I have found LLMs to be particularly unreliable and mostly useless. I also find most "AI" generated art to be either boring, inaccurate, or in some way not compelling. That said, I think the trend is becoming clearer.
- csours 3y agoI don't want any more Disney live-action remakes, but I'd like to see more variety in art styles, like the latest animated Spiderman and Ninja Turtles movies, which I understand are made with the assistance of generative models.
- ilaksh 3y agoI'm hoping that someone comes out with an open source version of Imagen or something similar. https://imagen.research.google/ https://imagen.research.google/ Or Parti https://sites.research.google/parti/ https://sites.research.google/parti/
- yieldcrv 3y agoVery pragmatic view from Sam, he is missing that the “gacha” nature will go away People will prime their image generation with a specific series of image and combine them with new prompts, packages will be made to prime their AI and then they’ll go from there
- dragonwriter 3y ago> People will prime their image generation with a specific series of image and combine them with new prompts, packages will be made to prime their AI and then they’ll go from there Whether its finetuning checkpoints, creating LoRa/Hypernetworks/TIs, etc., that's already the status quo.
- yieldcrv 3y agoyeah but I’m referring to just persisting a session, going down a tree of output from a root
- dragonwriter 3y agoSo, you mean the workflow-persisting behavior of something like ComfyUI? Again, we’re already there.
- yieldcrv 3y agoThe second time you said that, the first time it seemed informative at least for anyone passing by but now its not, take a step back then and notice that I didn’t say we weren’t, I said the article/author didn’t factor it in And the only reason i wrote it is because I’m aware of what people do
- duckmasterflexy 3y agoI have been using stable diffusion for my web designs and it’s been working great for me but I always build my figma designs separately. I use the generated designs as a palette where I sample from. It’s a glorified Behance or Pinterest vision board. Chat GPT is similar with code as it’s a glorified stack overflow where I get inspiration or quick fixes. The AI tools haven’t as of yet been so cohesive enough to replace the aggregator of these pieces of inspiration. Being classical trained in not CS and design will always be needed to filter AI suggestions. AI will eventually get proficient enough to reach that stage, but as it is now, it’s not even close.
- kwertyops 3y agoI wonder if you could elaborate on how you use ChatGPT to generate web designs? I'm about to teach a course on web technologies and I want to integrate ChatGPT into the curriculum.
- Animats 3y agoIf your idea of illustration is some irrelevant piece of clip art, it hardly matters. If the illustration actually illustrates the content, you probably can't generate it with current AI anyway.
- larodi 3y agoI’ve been using MJ and dalle to create actually used print content for some posters. This process of ai assistéd illustrator work is very fast. More than 7 works so far, and I’m not a designer, just know basic principles .
- greatNespresso 3y agoInsightful, agree with the fact that AI will help to fill up the "furniture" more easily, faster and for a cheaper price than any human could. Regarding transparency of training data, this is where I see huge opportunities in AI for the near future.
- akeck 3y agoThere's also the issue that SD/MJ-generated images cannot be copyrighted in the US.