12 ms·
How a Stable Diffusion prompt changes its output for the style of 1500 artists
- akie 4y agoIt would be so much better to just have all of these 1500 pictures next to each other in a list with the artist's name under it.
- FiReaNG3L 4y agoOr at the very least with the list of artists alphabetically sorted!
- kjeetgill 4y agoThey're sorted by last name, it took me a second too! I just wish I knew more of them.
- klyrs 4y agoMost of the names are sorted! Scroll to the very end...
- ido 4y agoSorted by last name but listed by first name means you can start typing the artist's name and get to the right place in the list...
- Kerbonut 4y agoYou can do it anyway assuming they used a moment js framework and took 2 seconds to configure the list order and search order
- adityashankar 4y agoI've sorted them in alphabetical order now
- ralfd 4y agoYES! I got mildly irritated using that clunky list.
- deleted 4y ago[deleted]
- wilg 4y agoI think the idea is for the comparison to remain spatially consistent because that's what it's trying to highlight!
- gvv 4y agoIndeed, what I ended up doing was Inspect Element > Search the name I want > Add the "selected" attribute to the option.
- amelius 4y agoIncluding a few real sample pictures from the artist, or a link to a google image search of the artist name, so you can check if the generated style matches.
- Aeolun 4y agoGot to love how Bob Ross style gives everyone a huge afro.
- jerpint 4y agoI wonder how constant everything else is kept, e.g. The seed. It's interesting that all the poses seem to align
- mjamesaustin 4y agoI noticed that too! I'm guessing they used the same seeds, which does a great job of providing a comparison in style.
- wccrawford 4y agoYeah, they use the same seed, which is used to generate random color pixels. Then they algorithm takes it from there.
- pain2022 4y ago
- ShamelessC 4y ago> What is this list?! No Picasso, Renoir or Vrubel present Comments like this are why people think HN is nothing but a place to receive a shallow dismissal of your efforts. It's a list. Make your own.
- kwertyoowiyop 4y ago“Be the change you want to see in the world” has kept me from posting many unhelpful comments.
- jazzyjackson 4y ago> Comments like this are why people think HN is nothing but a place to receive a shallow dismissal of your efforts. whatever
- ShamelessC 4y agoWhat is this?! One word comments?!
- the_only_law 4y agoYes, it’s been like this for a while.
- hecanjog 4y agoFunny that the Bob Ross version just makes them look like Bob Ross. Maybe there are more pictures of Bob Ross in the training set than his actual paintings.
- chris_overseas 4y agoThe same thing happens for Vincent van Gogh, and presumably others too.
- pessimizer 4y agoA good measure for whether you're more of a celebrity or an artist is how much of your face a google-image trained AI thinks belongs in your work.
- malikNF 4y agoWell what if the artist has a popular self portrait?
- pessimizer 4y agoSmoke comes out of the computer, and Captain Kirk notches another victory for humanity.
- kjeetgill 4y agoFrida Kahlo comes to mind.
- pmoriarty 4y agoShe's a rare exception in that she's mostly known for her self-portraits. Most other famous artists are mostly known for other things. Again, if the training data was labeled well enough, confusion about this sort of thing shouldn't happen.
- 4y ago
- pessimizer 4y agoFrom an artist to a brand identity.
- norwalkbear 4y agoTruly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99
- yieldcrv 4y agoTheir career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.
- krisoft 4y ago> The people making fliers have been replaced by AI prompting overnight. Hmm, no? Do go and try to make a flyer with any of the AI generators. I’m not saying it can’t happen one day, but the current tech is not there.
- pessimizer 4y agoFlyers are an extremely low bar that AI sails over.
- theelous3 4y agoshow an example?
- pessimizer 4y agoI used to draw the flyers when my band played shows. People still went to the shows. If had iterated a few times with one of these models to draw the thing that I wanted to draw rather than deluding myself, and spent 5 minutes polishing it in photoshop, the product would have been orders of magnitude better imo.
- 4y ago
- whywhywhywhy 4y agoUI should allow you to choose from the images and get the artist name.
- ttoinou 4y agoHow come the faces features and body parts are almost always at the same place on the image ?
- seydor 4y agoI wonder who is analyzing the weights of the model. At what level is the dimension of "artist name" represented, what is above it and what is below ?
- robbles 4y agoInteresting that it seems to have no concept of the filmmakers they tried to include here - Tim Burton and Walt Disney didn't produce anything recognizable and look to me like the default stuff you get without providing a style.
- yieldcrv 4y agoWe need to solve more captchas
- antman 4y agoNice, list could be sorted though
- j5155 4y agoIt’s sorted by last name
- deleted 4y ago[deleted]
- jhbadger 4y agoWhat frustrates me about Stable Diffusion is there doesn't seem to be any documentation as to what artists or vocabulary it understands. Generally people say "look at existing prompts or use various prompt generators" but that doesn't really solve the problem. I don't want to just look at what other people have randomly discovered; I want to know what the program really knows.
- deleted 4y ago[deleted]
- pwinnski 4y agoIt's the nature of ML models--nobody is 100% sure what it understands until they try something and get results. It was given a lot of tagged data: 600 million captioned images from LAION-5B. So if you want to know what it might support, you could try any one of the captions from those 600 million images.
- jhbadger 4y agoBut why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.
- spijdar 4y agoI don't think the underlying model is word based, but character based. You could download the caption data for LAION and grep that, but it's not strictly 1:1 with what SD was trained against.
- nl 4y agoNo, it's word based. The vocabulary is here: https://huggingface.co/openai/clip-vit-base-patch32/resolve/main/vocab.json https://huggingface.co/openai/clip-vit-base-patch32/resolve/... It is contextual though, so words in different orders mean different things.
- dr_dshiv 4y agoI sure would love to see this systematically improved. Angel Adams, for instance, clearly wasn’t too present in the dataset.
- alexmolas 4y agoNice experiment! I would only change two things: (1) sort the artists in alphabetical order, and (2) allow users to write the name of the artist and show if it's in the list. I'm saying that because it's a little bit tedious to search for the artist you're looking for. A part from that, I find the idea super-interesting :)
- MattPalmer1086 4y agoThey are in alphabetical order, but by last name. Took me a while to see that though.
- sva_ 4y agoYou can also just focus the select element and enter the full name to make it jump to the right name. But a real input would be better.
- adityashankar 4y agoI've added a search function now, I'll change it to be in alphabetical order gimmie a sec
- adityashankar 4y agodone
- alexmolas 4y ago
- sva_ 4y agoThe Jackson Pollock one amuses me. He didn't really draw such symbolic pictures afaik, so applying the style makes little sense.
- logisticpeach 4y agoHate to say it but when i see stuff like this it only reminds me of what we could have achieved if this ingenuity had been applied in another domain. Can't help feeling that this accidentally harms creative types and risks swamping us with visual junk. The technical achievment is astounding but no-one would seriously claim that crafting an image via a short prompt is creative except in the most cursory way. I'm probably missing some life changing use-case, but apeing art in random styles can't be it.
- _zoltan_ 4y agowhat other domain would you suggest which requires roughly the same skill set?
- victor9000 4y agoWell, robots have been better than humans at playing chess for decades now, and we still have chess players.
- eru 4y agoMore impressively, chess has not only survived as a human past time. But we still have professional human chess players.
- smilespray 4y agoFeatures John Wayne Gacy...
- nopenopenopeno 4y agoDavid Hockney was a big disappointment. Edward Hopper was pretty impressive.
- wcedmisten 4y agoVery cool! I recently made a game kind of like AI "pictionary" where the user has to guess the "artist", subject, and description of a piece of art generated by stable diffusion: https://wcedmisten.fyi/project/paintingGuesser/ https://wcedmisten.fyi/project/paintingGuesser/ I tried to make something more general, but stable diffusion is fairly inconsistent in how well the output matches the semantics of the input.
- matthewfcarlson 4y agoThis is really awesome
- ForRealsies 4y ago
- shawnz 4y agoThis could be a good candidate for a wordle-style scoring system
- MarcoZavala 4y ago
- pvillano 4y agoI've only tested craiyon but I'm sure SD and D-E the others fail the "shirt without stripes" test
- krumbie 4y agoWhat's kind of crazy is how the images tend to have similarities in small features that become very apparent when flipping back and forth between images, but which are not obvious per se. For example, I flipped back and forth between Beatrix Potter and Paulus Potter. A rounded white bonnet in one picture becomes a couple of blossoms in the other. The roof of a house becomes some shadowy wall with plants in the other. Two flower pots are very similar, just with slightly different coloring. It makes it more apparent that the algorithm etches the images out of noise, and if the seed is the same for two images with different prompts, you're likely to see traces of that noise represented differently but recognizable in both images.
- djmips 4y agoSo interesting, and really seems somehow related to how we dream, hallucinate.. or even experience reality?
- deltasevennine 4y agoArguably it could be different from our experience. It could even be a superior and more efficient methodology then the things our brain uses to imagine things.
- kache_ 4y agofrom "is your blue my blue" to "is the AI's blue our blue" :)
- daveguy 4y agoThe positioning seems very consistent, almost to the point where I wonder if that was part of the selection process to demonstrate the differences in style. There are only four per style, where the position of a subject could be a selection factor. Hard to tell if the position similarities are driven by the Stable Diffusion model or by the selection of representative images.
- olejorgenb 4y agoMaybe it's based on img2img? Some are different enough that it's not obvious that's the way it has been done though.
- layer8 4y agoThe result for H. R. Giger didn’t quite live up to my expectations.
- sexangel 4y ago
- kvetching 4y agoWe are going to need a new patent system.
- jenny91 4y agoPatents have nothing to do with protecting art: they are supposed to protect inventions.
- EVa5I7bHFq9mnYK 4y agoInteresting, how with billions of nodes and supposed "intelligence", the network hasn't been able to deduce a simple concept of symmetry in human faces. All of the eyes and all of the lips in all of the pictures are asymmetrical, which easily gives AI generated images away.
- MengerSponge 4y agoIt feels like they really only track local continuity without any meaningful knowledge. Hands are wonky and wrong in ways that don't look like any drawing I've ever seen. Horses with five or six legs. Humans also have a hilariously hard time drawing bicycles, but at least we pretty much always nail the number of appendages.
- pmoriarty 4y agoMidjourney is way better than this, though it too can produces some weird results... but at its best it's absolutely indistinguishable from photographs or art made by humans.
- capableweb 4y ago"Facial symmetry === beauty" is not that old of a scientific concept, relatively new if you compared to how long humanity has existed before someone started to really study it. And even so, too symmetrical faces will look just as un-human as a face that is too asymmetric. You need a face that is just the right amount of symmetrical in order for it to actually look good. I think you make it sounds simpler than what it is. It's also not a model that is trained to make as realistic people as possible, it's trained on a lot of different things, so obviously it won't excel at making realistic people. But one can easily imagine that some future models will be heavily trained on making realistic people rather than semi-realistic everything, like Stable Diffusion is trained to do today.
- chaxor 4y agoMany of the artists in this list specifically try not* to have this symmetry present in the faces. It's what makes many styles of art separate from just taking a photo or simply going outside. The system used here is actually astoundingly good at producing many artists stylesbecause it's not going for symmetry.
- vtuulos 4y agoIf you want to experiment with something similar by yourself and you don't have the patience to wait for Stable Diffusion to crunch through thousands of images on your laptop or in a Colab notebook, here's how you can parallelize processing relatively easily on AWS Batch or Kubernetes: https://outerbounds.com/blog/parallelizing-stable-diffusion-production-use-cases/ https://outerbounds.com/blog/parallelizing-stable-diffusion-...
- boplicity 4y agoThe concept of "derivative work" is pretty important in copyright law. I wonder if anyone has thoughts on this, in terms of this type of project. Should there be legal implications to this? I know someone -- a completely unknown artist -- who used to make a fair portion of their living by drawing D&D characters for people. Unfortunately, orders slowed down, because someone can input one of his images into software like this, and generate endless variations in the same style. Should this be allowed? Are images created "in the style of" a certain artist completely dependent on images created by that artist? If so, should that artist be compensated? Why or why not?
- pmoriarty 4y ago"Should there be legal implications to this? ... Should this be allowed?" Even if there are laws against it, the cat's out of the bag. There's no stopping billions of people all over the world making derivative works at the push of a button.
- nearbuy 4y agoA human artist can freely paint something in the style of another artist. It's not considered a derivative work. You can't copyright a style. A derivative work is an adaptation, translation, or modification of a particular, existing copyrighted work. If you asked Stable Diffusion for "Vincent van Gogh's Starry Night with a cat looking at the sky", you'd get a derivative work (although Starry Night is in the public domain, so you wouldn't be violating its copyright).
- egypturnash 4y agoHow a Stable Diffusion prompt makes working artists sad and grumpy about huge abuses of “fair use” in 1500 ways.
- llanowarelves 4y agoFix the list: Hunter Biden is missing
- deleted 4y ago[deleted]
- EGreg 4y agoHow can we set up Stable Diffusion on our own Linux servers, so we can generate NFTs or whatever?
- SergeAx 4y agoBosch is marvelous. Mucha and Monet are good. Michelangelo tries to be more like his sculptures. Not sure about Walt Disney and Roy Lichtenstein, and Rembrandt version is especially ugly. Maybe it will worth to get rid of "van Rijn" in that sample. Overall: the impression is better with author's popularity. I think if we train the model only with well-tagged filtered dataset - results may be much better, but we effectively will get a 5-year old Prizm app.
- theiz 4y agoWish there was some AI tool that could do some proper ligne Claire. It seems to be quite impossible. Oh, as is Escher, but I do understand that one.
- bee_rider 4y agoIt is sort of funny/interesting -- I only tried a few, but famous anime or manga artists (try "Junji Ito" or "Hayao Miyazaki") seem to have at least one picture that is clearly the result of the algorithm picking up on their fans' art.
- amelius 4y agoThis website should include a google-image-search link to the artist, so you can compare the styles more easily.
- LegitShady 4y agoHonestly I don't think its very good at emulating style. It picks up some things but often times misses the heart of the matter. Did some spot checking with some of my favorite artists. Rockwell's paintings are all about storytelling, clearly not present in the work. Their emulation for frazetta doesn't look like frazetta's work at all. HR Giger emulation is a joke. David finch at least gets a penciler's style but misses the use of solid blacks and dynamic posing. Frank Miller doesn't look like miller's work at all. etc etc etc This list goes on and on. Personally while I understand using the 'in the style of' as a way to change the image results, I think in many many cases the results just don't look like the art of that artist.
- biztos 4y agoI’ve been idly working on a similar list but with a much more basic prompt. The results vary wildly, even run by run, but I might put them in a few buckets: 1. Similar enough that someone who doesn’t know much about art could be fooled 2. Amateur knockoff but recognizable style 3. Influence is there if you know what to look for 4. Artist probably not in the training data at all The last one kinda surprised me, for artists whose work is online and who have unusual names. I would have thought those cases would be really good. Maybe they ran out of disk space with all the porn? Also interesting that it gets much closer for figurative painters than for abstract painters.
- Angostura 4y agoI like how the algorithm sometimes confuses the style of the artist with the facial features of the artist. Try Bob Ross
- iamwil 4y agoStable Diffusion now makes art history a desired line of study.
- PaulHoule 4y ago... boy I was hoping for Barbara Krueger.
- Daub 4y agoI lecture in painting, and to me some of these are truly impressive. Not surprisingly, those artists is not predominantly painting (e.g. Josph Beuys) or is predominantly linear (Audrey Beardly) do not fare so well. There is a lot of talk in our department as to how we might prepare our students for this technology. It is scary how fast it is growing, and how it is spreading to things like 3D and texturing. One of my team is already using it in production. It used to take his artists three days to come up with five visual development ideas. Now he can get fifty overnight to choose from.
- bragr 4y ago>Not surprisingly, those artists is not predominantly painting (e.g. Josph Beuys) or is predominantly linear (Audrey Beardly) do not fare so well. To my untrained eye, these both look pretty good. https://static.adityashankar.xyz/gorgeous/hair_flowers_full/generated_art/artists/523451983313:Aubrey_Beardsley/flower_woman:2767393:50:PNDM.jpg https://static.adityashankar.xyz/gorgeous/hair_flowers_full/... https://static.adityashankar.xyz/gorgeous/hair_flowers_full/generated_art/artists/955137416256:Joseph_Beuys/flower_woman:2767393:50:PNDM.jpg https://static.adityashankar.xyz/gorgeous/hair_flowers_full/...
- Daub 4y agoI agree, they are nice results. But Joseph Beuys is better known for performance art. In his most famous piece, he covered himself in gold foil, and explained art to a dead hare (below). To my mind, it makes little sense to apply this method to his art. https://uploads4.wikiart.org/images/joseph-beuys/how-to-explain-pictures-to-a-dead-hare.jpg!Large.jpg https://uploads4.wikiart.org/images/joseph-beuys/how-to-expl... The Audrey Beardly results are a bit better, but if I wanted Beardly-ish drawings I would likely be disappointed. Beardly's lines were very fine... 'filigree', like a spider crawling over the paper, and he almost never made art in colour. Also, a lot of his work was as sexy as hell. NSFW last link (bottom of page) for relatively mild examples. https://uploads2.wikiart.org/images/aubrey-beardsley/the-dancer-s-reward-1894.jpg https://uploads2.wikiart.org/images/aubrey-beardsley/the-dan... https://www.theparisreview.org/blog/wp-content/uploads/2015/08/aubrey_beardsley_-_edgar_poe_1.jpg https://www.theparisreview.org/blog/wp-content/uploads/2015/... https://www.messynessychic.com/2019/11/13/the-world-wasnt-ready-for-oscar-wildes-fearless-illustrator/ https://www.messynessychic.com/2019/11/13/the-world-wasnt-re...
- elcomet 4y agoIt doesn't really work. I just tried "Vincent Van Gogh, and the images have absolutely nothing to do with his style. Same for Gaugin. If it doesn't work for such famous painters, hard to trust it for the other ones.
- felipeerias 4y agoSearch is broken. Using the arrows works. Vincent van Gogh: https://static.adityashankar.xyz/gorgeous/hair_flowers_full/generated_art/artists/75099583939:Vincent_van_Gogh/flower_woman:2767393:50:PNDM.jpg https://static.adityashankar.xyz/gorgeous/hair_flowers_full/... Paul Gauguin: https://static.adityashankar.xyz/gorgeous/hair_flowers_full/generated_art/artists/14248381363:Paul_Gauguin/flower_woman:2767393:50:PNDM.jpg https://static.adityashankar.xyz/gorgeous/hair_flowers_full/...
- elcomet 4y agooh ok, looks much better indeed
- lastdong 4y agoGreat job, always great to follow SD news! We’re missing Picasso? Salvador Dali not sure, maybe expecting something different.
- woolion 4y agoIt's really interesting how good some of the results are, but the styles seem to be completely mixed up. Just looking up Claude Monet, and there isn't anything impressionist. Leonardo da Vinci, on the other hand, give results that rather look like British impressionist paintings. I've seen paintings in the style of Donato Giancola that really looked like his style, but in the examples of this site none of the result do. Maybe there needs to be some adjustments to the prompts?
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]