10 ms·
Why Does This Horrifying Woman Keep Appearing in AI-Generated Images?
- bm3719 4y agoIf you like this, you'll want to see this AI-generated music video if you haven't already: https://www.teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai_generated_music_video_using_disco_diffusion/ https://www.teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai...
- ddalex 4y agois it the same artist / same woman ?
- kcplate 4y agoWell that shit is gonna haunt me for a while…
- krageon 4y agoI clicked this thinking "how bad could it be?" and closed it as fast as I could. This is nightmare fuel, probably don't click it.
- kthejoker2 4y agoAs a counterpoint, everyone should absolutely click it, yes it's a bit creepy but it's not NSFL or anything and as generated art it is amazing, and needs to be studied and appreciated more.
- kortex 4y agoI get squicked-out pretty easily, and I didn't find this too aversive. Art-wise, it's absolutely mesmerizing. I could definitely see this technique becoming a stable of the black metal / witch house / etc genres.
- hombre_fatal 4y agoSeems odd to be unable to watch this rather tame video tbh. I would consider trying to transcend it rather than cultivate such a low threshold of fear.
- StrictDabbler 4y agoThis just looks like coming down off LSD. Google's deep dream videos looked like coming up. I guess it's useful to have an accurate video simulation so you can decide whether it's for you.
- 2-718-281-828 4y agoi have tripped dozens of times and never seen something like this. the visual mechanics are trippy but to see something like that i'd probably have to be in a really bad head space watching horror movies during the peak. never tried that, though. prefer to stick with documentaries and funny movies.
- xyzzy4747 4y agoIt’s almost like a cancer got into it and metastasized into all of the frames.
- kthejoker2 4y agoThanks I hated it, but also it is lowkey amazing. The fluidity of the generation seems way more "natural" than most CGI. Definitely the way forward for every horror video game.
- nico 4y ago> The fluidity of the generation seems way more "natural" than most CGI. It’s probably because it’s not fully AI-generated. It’s essentially a real video with a filter applied to it[1] 1: https://teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai_generated_music_video_using_disco_diffusion/in66xlm/#c https://teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai_gen...
- Wojtkie 4y agoIt would be really a cool experiment to have AI generated visuals real-time in a video game.
- nico 4y agoJust and FYI. It’s pointed out in the comments there[1]: the video is not fully AI-generated. It’s a video of a real girl to which some AI was applied to afterwards. 1: https://teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai_generated_music_video_using_disco_diffusion/in66xlm/#c https://teddit.net/r/nextfuckinglevel/comments/x6d3c3/ai_gen...
- ddalex 4y agoI think this just tapped into our collective subconsciousness...
- dmarchand90 4y agoIf you play around with these tools the overwhelming majority of images are deeply disturbing. Melted faces, fused bodies, hands with unusual numbers of fingers. I think this machine produces objects deep in the uncanny valley.
- danielbln 4y agoI've spent more time than I'd like to admit with Dall-E, Midjourney and SD and I disagree with your sentiment. Sure, you can create a bunch of weird creepy shit, but by no means are the overwhelming majority of images deeply disturbing, as you put it. Just scroll through https://lexica.art/ https://lexica.art/ which catalogs 10M+ StableDiffusion images, most aren't even close to being disturbing and are in fact aesthetically quite pleasing.
- simonh 4y agoThose are selected images though, so not representative.
- l33tman 4y agoYou get 4-9 images at a time and it takes literally 2 seconds to look and decide which to save. Saying it's "unusable" because you CAN get bad images is missing out..
- burnished 4y ago"representative" is not the same concept as "unusable", so you should not put quotes around that text. It's like going to the grocery, seeing a bin of beautiful apples and saying "every apple on the tree is beautiful". You can't draw that conclusion because those apples aren't representative of all apples because they went through a filtering process. In this case some one choosing to sell them. Upthread, some one choosing to share them.
- throwanem 4y agoI'm surprised it's taken this long for someone to produce the first creepypasta of the image-generating AI era, if "era" is the right word. I'm not all that surprised Vice reported on it so credulously.
- NoToP 4y agoI spent longer than I care to admit trying to figure out if "Loab" was some word play that Vice had not picked up on.
- deleted 4y ago[deleted]
- scambier 4y agoThe woman appeared once, and they kept combining it with different prompts. So it stayed in the subsequent images. https://twitter.com/supercomposite/status/1567164929903394816 https://twitter.com/supercomposite/status/156716492990339481... https://twitter.com/sheslostheplot/status/1567370919487893504 https://twitter.com/sheslostheplot/status/156737091948789350...
- ddalex 4y agoThe interesting bit is not that it remains there, but that it seems to generate dark images (gore, violence) regardless of the input.
- vlunkr 4y agoI know very little about this stuff, but doesn’t that just mean that the algorithm considers the original image to contain gore/violence?
- nerdponx 4y agoIt at least considers the original image adjacent to gore/violence, but there's something uncanny about how the "Loab" image itself is not a gory or violent image. There's something funky going on along a "concept axis" involving the upside-down triangles on the face, the rosacea, and the overall bleak composition of the image.
- towaway15463 4y agoThe image looks a lot like the haggard female protagonists or victims in a lot of horror movies so it could just be a composite of those. The rosacea might be due to it confusing blood splattered faces with medical images. Honestly it just looks like a still image from a horror trailer to me.
- nerdponx 4y agoI think it is somewhat interesting that it remains there, apparently after many many "generations" of combining with other images. It's also interesting to consider what this image was originally "far" away from. There are a couple of good followup threads exploring how such a thing might come about in the "latent space" of the model: https://twitter.com/jthteo/status/1567418273628655617 https://twitter.com/jthteo/status/1567418273628655617 https://twitter.com/mattskala/status/1567300206969982979 https://twitter.com/mattskala/status/1567300206969982979
- dougmwne 4y agoLooks like we discovered some kind of dark nexus in the collective subconscious. Img to text models could probably put words to this which would help us loop back and understand exactly what collective concept we were looking at. Somone here on HN has said that they use these AI models to explore the latent space of the human imagination. I would say that sounds exactly correct.
- adamsmith143 4y ago>Somone here on HN has said that they use these AI models to explore the latent space of the human imagination. Bizarre. It's like saying that you are using the newly invented Bicycle to explore the concept of General Relativity. Woefully insufficient.
- dougmwne 4y agoWas the bicycle constructed out of every thought ever recorded and every image ever created?
- adamsmith143 4y agoThe bicycle contained a form of all engineering and physics knowledge of the time.
- hgsgm 4y agoOfficial statement, dunking on the normies: https://twitter.com/supercomposite/status/1567664073759678464 https://twitter.com/supercomposite/status/156766407375967846... > To clarify for the press (many are asking for an explanation without jargon): I have brought a real IRL demon to life. Research has found that demons are real and live inside of computers. Computers are like little houses for demons and church is like a big house for angels.
- somehnacct3757 4y agoI asked DALL-E to draw a self portrait of itself and its family one time, and the results still make my hairs stand up. DALL-E itself was Clippy-like, blue, and bean shaped with eyes and mouth more expressive than a Zuckerberg VR avatar. As for the family? There was none. DALL-E rendered itself on a pure black background
- diegoperini 4y agoCan you please share the image if that's okay?
- somehnacct3757 4y agohttps://i.ibb.co/7y08y2H/unknown.png https://i.ibb.co/7y08y2H/unknown.png I left out the bit how DALL-E also thinks maybe it's a honey badger, or a lemur with all black eyes, or some sort of sharp wood demon. The blue one is the one that haunts me because it seems to be the most plausible
- DangMeatSlurper 4y ago
- thedorkknight 4y agoHah! I love the one in the bottom-left that looks like it's flipping us off. This reminds me of playing around with Craiyon a few weeks back. It seemed to think of itself as a coyote who loves soccer. Of course, the training datasets aren't going to have data on dalle or craiyon, so those prompts are going to be more based on the other words, with some randomness
- bee_rider 4y agoCrayon-dice is a perfect avatar for an image drawing AI.
- kingkawn 4y agoThe algorithm may be referencing Craiyon, the dall-e lite
- Octoth0rpe 4y agoMaybe DALL-E just.. you know. Has a type.
- schaefer 4y agolol. thank you for that.
- userbinator 4y agoThey are simply too big, and their results too unpredictable, to reliably prevent harmful results. That seems like a surprisingly deep philosophical statement on society in general. And IMHO, along the same lines, "reliably prevent harmful results" is not something that should be pursued to exhaustion.
- nix0n 4y agoThe creators of the mainstream AI art generators went to great pains to prevent these tools from being used to generate pornography. If you want to talk about statements on society in general, I think the fact that nudity is seen as more harmful than gore, is a bigger problem than an AI generating either one.
- ShamelessC 4y agoI’d just like to point out that there’s no way to “win” this battle. If you release models or datasets that have or can predict porn, you will get an equal number of complaints from the people who think your model/dataset is irresponsible or only useful for smut. In fact, the dataset used to train it received precisely this criticism on HN back when it was originally announced.
- that_house 4y agoLooks a bit like Toni Collette. She’s in a bunch of horror movies?
- nerdponx 4y agoWere there screenshots of horror movies in the training data? That could explain a lot.
- edent 4y agoCrungus is another one which keeps coming up. Perhaps there is some thing the machines can see, but our psychology protects us from?
- giantrobot 4y agoSee that is a good creeypasta concept.
- schaefer 4y agoIs this just a new AI ghost story, or is there actually something scientifically repeatable here? Can we please get real nerdy about this? The article broadly describes a series of prompts, but do we have enough information figure out which AI engine was used, reverse engineer some likely prompts, and try to produce similar results (not exactly the same, as that may not be possible with AI prompts)? Is it even possible to ask an AI image generator to "produce the opposite" of a prompt? Is this just an RTFM moment (for me)? or is "producing the opposite" a misunderstanding of how weights work. I only have experience in midjourney, but my understanding is that with midjouney you can weight various prompts as ratios. For example I can build up a prompt to generate an image that is 2 parts "autumn landscape" and 3 parts "birthday cake". But with ratios, isn’t it true that negative weights just discarding that prompt? They don’t produce “the opposite”, right?
- schaefer 4y agofrom Supercomposite's original twitter post, we can see they claim to start off with a negatively weighted prompt of "Brando::-1" To me, this looks like midjourney prompts. At least we can say, that is valid midjourney syntax for sure, and it is using weights. but probably not to the effect the author portrays. for example, if I prompt "/imagine autumn landscape::2 birthday cake::3", I get this image[1]. But now if I tweak the prompt to "/imagine autumn landscape::-0.5 birthday cake::3", I get this image [2]. Critically, there is no trace of "opposite of an autumn landscape" in this image. It's all birthday cake... 100%. Indeed, this lines up with some midjouney documentation[3]. A negative weight will try to remove the thing in the prompt. BUT: what happens when we only have one prompt, and we use a weight to negate it in midjourney. i.e: "/imagine Brando::-1". At least for me, it get this error: "Invalid parameter The sum of all of the prompt weights must be positive" So I'm inclined to conclude that Supercomposite's post is more an act of creative story telling, than an accurate portrayal of their interactions with Midjourney. But I am still left wondering if there is a true "opposite of" operator in any AI image generator. [1]: https://cdn.discordapp.com/attachments/1006400576067739749/1017438050646761562/slowcamp_autumn_landscape_0253e597-b56e-4469-89b9-38ffe63a0675.png https://cdn.discordapp.com/attachments/1006400576067739749/1... [2]: https://cdn.discordapp.com/attachments/1006400576067739749/1017440309816340521/slowcamp_autumn_landscape_bd2939cd-a393-412f-870a-12b1e94dd851.png https://cdn.discordapp.com/attachments/1006400576067739749/1... [3]: https://midjourney.gitbook.io/docs/imagine-parameters#prompt-modifiers https://midjourney.gitbook.io/docs/imagine-parameters#prompt...
- dvh 4y agoShe's AI version of Null island: https://en.wikipedia.org/wiki/Null_Island https://en.wikipedia.org/wiki/Null_Island
- usednet 4y agoLoab looks remarkably similar to Billy the Puppet from Saw, which could explain its relation to gore and violence.
- mc32 4y agoLet's not ask it for socio-political advice as it may tend towards Marxism-Leninism with some Maoism kicker. What should we do about the energy crisis? Make them go out and chop wood. What should we do about quiet quitting? Send them to the gulags. What do we do about dissidents and people who disagree with us? Send them to the furthest gulags. What about the poor wheat and corn production this year? Kill all the birds.
- blastonico 4y agoHorrifying woman? I thought it was an Ozzy Osbourne picture. EDIT: I'm not kidding.
- zh3 4y agoIt would not amaze me if you're spot on. Lots of images scraped off the 'net, especially celeb websites and quelle surprise.
- plainnoodles 4y agoSo "why" is just "idk" and it seems like the person generating them found her on accident once, and then kept trying to find her again. I'm a fan of a good creepypasta and honestly a memetic SCP that "lives" in the models of AI sounds pretty tight to me. But this ain't it. I'll admit I was expecting the "why" (aside from SCP...) to be something like "turns out DALL-E gets live humans and corpses mixed up and in macabre images the live humans get a bit more corpse-y due to this".
- daniel-cussen 4y agoA wicked witch!
- fallingfrog 4y agoGood lord, I didn't realize that an AI generated image could be so shockingly frightening. To be honest the fact that DALL-E can do the things it does is very worrisome for me. I think we shouldn't go down this technological path.
- bee_rider 4y agoJust to be clear: > “I can't confirm or deny which model it is for various reasons unfortunately! But I can confirm Loab exists in multiple image-generation AI models,” Supercomposite told Motherboard. this is almost certainly a creepypasta which Vice is for some reporting as if it is real. He probably found a creepy picture and then started using it as a seed or something like that.
- yieldcrv 4y agothis is dumb but I’m trying to play along and match the energy
- m3kw9 4y agoThe ghost in the machine.
- bitwize 4y agoClearly we are looking at a Keter-class infohazard.
- HereIGoAgain 4y ago
- cyanydeez 4y agoEh. Looks like ozzy Osbourne
- sidewndr46 4y agoAnyone else not find this image disturbing at all? Looks like she is suffering from a severe skin condition. That's about it.
- 2-718-281-828 4y agoopened to check if she looks horrifying. yes, "she" does ...