22 ms·

Playing with DALL-E 2

298 points by nahuel0x 5y ago

015UUZn8aEvW 5y ago
I wonder how it would do with more technical engineering drawings, like shop drawings for machinists or blueprints for a building.
bobbyi 5y ago
What's the reason for the restriction on sharing images with faces?
- BlueTemplar 5y ago
  I assume the risk of giving the possibility of generating "person of group X doing something bad" ? Or more prosaically, we're MUCH better at noticing something wrong in humans (especially faces !) than in, say, puppies, so that would make DALL-E 2 look bad to an uninformed observer.
  - gwern 5y ago
    It's the PR risk. You can easily pass the 'look good to an uniformed observer' test with human faces. Remember, faces were something GANs were doing near-flawlessly back as far as ProGAN all the way back in the dark ages of late 2017. (Then StyleGAN did non-photograph faces, like anime - see my ThisWaifuDoesNotExist for a demo of that.) Doing them as part of a larger composition, where the face is a small part of the images and may vary much more than in closeup centered portraits, is harder, but take a look at how Facebook's DALL-E rival Make-A-Scene does it: https://arxiv.org/abs/2203.13131#facebook https://arxiv.org/abs/2203.13131#facebook They specially target faces as part of the training process, with face-specific detectors/losses, and so the faces come out great.
    - BlueTemplar 5y ago
      Fair enough, but it could be... both ! Since you know that training for photo-realistic faces is going to take extra effort, and that you're not going to allow them - you could just spare that effort ! (Or maybe leave it for later, if the network is flexible enough ?)
- probably_wrong 5y ago
  My theory is that the model would not generate new faces, but rather "copy-paste" faces it has seen in training. Therefore, if someone generates "famous person doing bad thing" and publish the results there's a non-insignificant chance of a lawsuit. And even if the person is not famous, putting someone's picture on an image could very well be a privacy violation in many jurisdictions.
globuous 5y ago
This is just insane. The image to the prompt "A dog looking curiously in the mirror, in digital style" shows a cat looking into a mirror and seeing a dog as itself! Although very creative and "objectively funny" (may cat is like a dog!!!), I think the AI understood "A dog looking curiously (is) in the mirror". These poems are absolutely hilarious also, it's photo-realistic, but the messages make no sense, though the fonts look so perfect! That's where you know it's clearly AI generated ^^ For now.... Sometime soon it looks like realistic pictures of protests are going to be so easy to generate with arbitrary text
- BlueTemplar 5y ago
  Your comment is going to be misinterpreted without the context : DALL-E 2 failed all the "X looking curiously in the mirror, but the reflection is Y" tests - showing X as the reflection instead, Dave Orr had to do some "hinting/editing" to achieve this : > Here's one where I edited out the cat in the mirror and changed the prompt to be about a dog, and it did something sensible.
- sharperguy 5y ago
  Gramatically speaking, shouldn't it be "dog looking curiously _into_ a mirror"?
slig 5y ago
Any ideas on how is this going to be priced? Will this model be open just like the GPT-3?
cromwellian 5y ago
"Attention is all you need" was published only 5 years ago in 2017. BERT in 2018, GPT-3 in 2020. Now DALL-E, PaLM, LaMDA, etc. The pace of AI progress is frighteningly fast. I really thin it's plausible that by 2030, AI is writing and debugging most code, and engineers basically become spec writers who manipulate prompts, generate code, and verify. Essentially, project managers whose "team" is a bunch of LLMs. It really doesn't seem we've hit diminishing returns on LLM model size yet, and that's not accounting for the multi-input types where video, text, audio, and more are being fused together.
- ummwhat 5y ago
  Ya stupid sons of bitches, you automated everyone else out of a job and then you gone done it to yourselves too!
  - CryptoPunk 5y ago
    Every higher level language, library and framewok automates coding. But the result is more complex programs, not fewer developers. That's a microcosm of the effect of automation on the economy as a whole.
    - ummwhat 5y ago
      90% of work used to be farming. Today 10% of people are farmers. The next big thing was factory work. At first looms meant more textiles, not less workers. But eventually we hit the transition point where there's actually less factory workers. Now we've moved on to "knowledge work". Sure the effects of automation make more complex knowledge products and jobs for now, but once the automation becomes advanced enough, jobs in the field go down not up. So what comes after knowledge work? We can't have it both ways. We can't pretend like automation will never kill our jobs while simultaneously pursuing the dream of permeant vacation through automation. The very goal of automation contradicts the idea that we would and should always have jobs.
      - CryptoPunk 5y ago
mensetmanusman 5y ago
Shutter-stock will be dead, crazy.
icey 5y ago
The text this generates reminds me of the kind of text you'd see in a dream. The images look real enough, and the text looks like words; but totally unreadable. Kind of an uncomfortable feeling.
- junga 5y ago
  I think I've never read text while dreaming.
  - nikonyrh 5y ago
    That, and looking at a clock is a great way to check whether you are in a dream or not.
  - aetherson 5y ago
    I have. You can read things while dreaming. Individual words are fine. But, just like dreams themselves, if you read more than a sentence or two, your mind will be unable to really keep a plot. And if you look away and read again, the text will have changed.
- jtsiskin 5y ago
  I don’t think this is a coincidence
- bryans 5y ago
  It's fascinating that the system is able to generate such precise imagery, yet can't handle words at all -- it can only barely reproduce words you explicitly tell it to. But sometimes it'll adds words when you're really not expecting it, and like you said, it's uncomfortable. Like the worst uncanny valley I've ever experienced. It was so unsettling to see the "four seasons" and "periodic table" that I couldn't stop nervously laughing.
  - TuringTest 5y ago
    I think the words examples provide insight into how the image generation works at several levels. You can clearly see [1] how the glyphs are created by approximately merging several letters in one place to create a new symbol, while maintaining the overall structure of words and paragraphs within a well-composed layout in the page. The periodic table [2] seems to be doing the same, where the layout is the structure of colored boxes and two sizes of letters within them. Image composition seems to be doing something similar, learning to associate concepts with their visual representations at the right level, and merging already-seen examples in the right proportions to create a novel image. Cats and vampires are represented by their distinctive features, arms and legs are correctly positioned as parts of the body according to the action they perform, and instructions of style (either by artists like "Pieter Brueghel", art styles like "digital" or "mosaic", or even camera settings like ISO exposure [3]) are translated into lower level pixel representations of color, shapes and shadowing. My hypothesis is that if you included examples where the letters are taught one by one, like in kindergarten primers, it may be able to learn those concepts as well and generate better painted text (although I'm not sure it could make the jump to "understanding" the relation between their role as input instructions and as output image text). [1] https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/855638801ffcab0188609438f8c5e20aae809d060078a505.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/855... [2] https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/15713cb1e41bc072449c572342d5c2767d1b5f586afe11bb.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/157... [3] https://www.bramadams.dev/projects/dalle-tricks#let-there-be-lighting https://www.bramadams.dev/projects/dalle-tricks#let-there-be...
neoneye2 5y ago
Incredibly good. Wow
e2le 5y ago
Very impressive. I'm left wondering whether DALL-E 2 could be used to generate furry erotica, among other things.
- gwern 5y ago
  No, almost certainly not - it's very heavily censored. So far I haven't seen anyone successfully generate anything you could call erotica. (One interesting consequence: the anime is not very good and it can be a struggle to generate anime at all https://www.reddit.com/r/AnimeResearch/comments/txvu3a/anime_x_dalle_2_thread/ https://www.reddit.com/r/AnimeResearch/comments/txvu3a/anime... ) If you mean just could such a model architecture be trained to generate furry erotica? Yes. Erotica, and furry art in general, in Tensorfork's experience, tends to be somewhat harder than regular images because of the more chaotic placement of everything such as limbs, but not that much harder. You might need half again as much compute to get equivalent quality results, perhaps, but probably not, like, 10 times as much.
  - astrange 5y ago
    If this is the same old CLIP model, I tried making anime with CLIP+GANs (usual prompt "chitanda from the anime hyouka") and it got the hair color right but nothing else - seemed to have first page of Google Image Search level knowledge. There have to be a lot of limits once you get far enough out of its training data. Even if you could guide it by image prompts, it has to know what that image is meant to represent. Also what most people mean by "anime style" isn't anime style, of course - they actually want one of Avatar-type cartoons, advertising key visuals, game characters, or pixiv/DeviantArt fanart. None of that is drawn the same way as TV anime.
    - ShamelessC 5y ago
      They trained a new noise-aware one on the same dataset, I believe. The CLIP is frozen though in the second stage where they train on a cleaner dataset for the image generation via diffusion conditioned on a CLIP image embed. They get the image embed from another model that can predict image embeds from text embeds to encourage generalizing when sampling. It does suffer from some of the same issues with binding attributes and counting stuff, as far as I can tell. But that's not necessarily related to its ability to compose concepts.
cwkoss 5y ago
I hope they aren't planning on selling the version which can generate realistic faces to regimes manufacturing propaganda.
- anothernewdude 5y ago
  Regimes manufacturing propaganda have cheaper ways of generating realistic faces.
- astrange 5y ago
  Modern uses of propaganda don't seem to need it to be believable to work.
  - astrange 5y ago
    Whoops, edit period closed. You can effectively use it to make it sound like every other side is unbelievable, or just to tire people into giving up, or get past spam filters by generating better than ever nonsense. And the in-group will take it as a point of pride to believe lies from their own group anyway.
    - cwkoss 5y ago
      I think the bigger danger is the speed that people will be able to fabricate 'evidence' to support a false narrative faster than photographs of an event can come in. The first images of a news story available could be fabrications. What if news organizations were able to put pictures of Saddam's WMDs (that remember, never existed) on frontpage stories while the executive was trying to manufacture consent for entering a war? I feel like the human brain is going to have a hard time being skeptical of fake news when fabricated fantasies can be rendered realistically.
      - vintermann 5y ago
        > What if news organizations were able to put pictures of Saddam's WMDs (that remember, never existed) on frontpage stories while the executive was trying to manufacture consent for entering a war? Then the outcome would be... exactly the outcome we had anyway, which was the OP's point. You can already lie with images with Photoshop. It's a little more work, but you can probably still hide it far better than you can pass off a DALL-E generated image as real. Lying with images isn't the problem. Telling a consistent lie, getting all the details right even when new evidence comes in, that's a problem, and this sort of AI doesn't help with that at all.
andy_ppp 5y ago
AI is some weird infinite mirror to existence. I think we will give birth to general artificial intelligence at some point but I’m thinking it might be stranger than we can possibly comprehend.
mikelemmon 5y ago
Maybe it's sarcasm, but the author seems to downplay these images. Are we really that jaded? This seems like criticizing a dog that learned to speak only basic english...the fact that any of this is even possible is stunning.
- bricemo 5y ago
  I agree. I could not be more blown away if a real UFO landed and aliens introduced themselves. A week ago all of this was impossible.
  - garbagetime 5y ago
    To people paying close attention, these results are unsurprising. The author is simply accurately assessing the novelty of the results. edit: fixed typo
  - nil-sec 5y ago
    This isn’t true, the quality of images generated by DALL-E are really good, but they are an incremental improvement and based on a long chain of prior work. See e.g. https://github.com/CompVis/latent-diffusion https://github.com/CompVis/latent-diffusion
    - gwern 5y ago
      Also Make-A-Scene, which in some ways is noticeably better than DALL-E 2 (faces, editing & control of layout through semantic segmentation conditioning): https://arxiv.org/abs/2203.13131#facebook https://arxiv.org/abs/2203.13131#facebook
- joe_the_user 5y ago
  Just about all the AI achievements are really impressive in the talking dog quality as you say. The thing is that current has been producing more and more things that stay at the talking dog level (as well as other definitely useful things, yes). So the impressiveness and the limits are both worth mentioning.
- 5y ago
jabthedang 5y ago
dean177 5y ago
I found the images with gibberish text to be unsettling, it reminded me of the mimic creature at the end of Annihilation. This is amazing, I wish I could play with it.
CarrieLab 5y ago
DALL-E 2 is a true "holy shit" moment for me. It's actually hard to believe it's real.
- PheonixPharts 5y ago
  It's interesting because for me it's the opposite. I feel DALL-E 2 is the clear evidence that we're headed for the next AI-Winter soon. Don't get me wrong, DALL-E is remarkable. But it's remarkable in almost the exact same way ELIZA was remarkable in 1966, and Markov Chain generative models were in the 1990s. All of these, given the context computational powers at the time, were both miracles and parlor tricks at the same time. The trouble is that these demos are impressive, but not much has changed in how the world works. I work in AI/ML and every places I've seen the practical applications of these techniques has ranged the equivalent to adding sprinkles on a cake, to completely useless engineering nightmares that would ultimately create more value with their removal. Yea, a 3.5 billion parameter model is neat, but we know that in 1970 when we couldn't imagine training such a thing. The problem is that we've made essentially no progresses other than showing when you pour incredible human and physical resources into a pot the result looks cool. But when you do the accounting, and ask yourself "what has really changed with all these fantastic innovations in machine learning" the answer is surprisingly little. Dall-E 2 is the type of cool that will be figure 12-3 in a undergrad textbook in 20 years. Students will go "oh that's cool" and turn the page.
  - nl 5y ago
    20 years ago we couldn't imagine doing visual search that worked in any way. Now we can do that in a model that runs locally on your phone. This is a pretty big deal.
  - nahuel0x 5y ago
    I think you are totally, totally wrong. This is a turning point. Artificial Imagination is just going to revolutionize all content generation, arts and designing. It will expand to video/VR generation and the input prompts probably will came from realtime neurofeedback. And not to mention what fantastic tool will become to explore the humanity collective unconscious and our fundamental nature. In some way is reifying our hive mind.
astrange 5y ago
The cards that aren't cards in "dogs playing poker" look like the wrappers booster packs for CCGs come in. The inability to spell words is because they're using BPE instead of actual text inputs, so it doesn't actually know that words are made out of letters.
- fastball 5y ago
  I dunno, the networks are sophisticated enough to make anatomically correct things, seems like it would make sense for real english words to crop up as well unless OpenAI deliberately nerfed that.
Trackmal 5y ago
I am stunned by these results and I find it absolutely amazing, but somehow this also makes me kind of sad. So many things we consider worth learning are loosing their value with these advances. It really makes me think if I should stop trying to improve my skills, because in maybe 20 years there is not much left what can not be done better by a machine. :/
- mmcconnell1618 5y ago
  DALL-E has been trained in the styles of creative humans. It can mashup the content that it has been fed but I haven't seen it create a new style of artwork like impressionism or pop art that it hadn't already seen as examples. It also has no understanding of what is generated. We are impressed as human observers because it appears to understand the task we presented.
  - gfodor 5y ago
    How many hours have you spent working with it so far? You obviously have a lot of experience with it, so I’m wondering how you drew this conclusion.
    - mmcconnell1618 5y ago
      Zero. But I did read the research paper, web site and viewed the web site mentioned in this hacker news post along with the samples. I've worked with lots of machine learning models and tools and understand the underlying design of the system. You can't ask Dall-E to create a pop art picture of Corgis if you didn't train it on images of Corgis and pop art. I'm not downplaying the achievement of the system that creates an incredible connection between the input images and the text descriptions. But.. at the end of the day. It is not creative in the same way humans are creative.
      - gfodor 5y ago
        That’s just begging the question. We don’t know if DALL-E is creative in ways isomorphic to humans. It might be. How would one go about structuring a hypothesis? Have you read the original DALL-E paper? Worth considering: https://arxiv.org/abs/2112.04035 https://arxiv.org/abs/2112.04035
gfodor 5y ago
Kurzweil was too conservative. This is the last decade of humanity, as we understand it today.
amcaskill 5y ago
This line stuck out for me: > I tried to ask for Dall-E by name but that was a content policy violation. It seems like they are trying to prevent it from visualizing “itself”. Is there a less exciting explanation?
- nighthawk454 5y ago
  less exciting: they put their brands in the blacklist they wouldn't want Dall-E's name plastered next to some harmful/offensive content. or generate uncontrolled PR from stupid meme articles. wouldn't be a bad idea to chuck all the companies names/brands in there. wouldn't be surprised if "OpenAI" and "GPT-3" are banned too. based on the comments, the policy violations cover a lot of territory - covid, explosive, nuclear war. one commenter said that "glass of guidelines" violates the policy, which is a nonsensical statement. suggesting either "guidelines" is a banned word. Or, maybe they have a content policy classifier, in which case a bunch of random stuff will probably trigger it. _for sure_ they're not worried the "AI might visualize itself", that's not really a thing
  - amcaskill 5y ago
    Right right, PR risk, not AI safety risk. Of course, that makes way more sense.
abdusco 5y ago
dall-e trying really hard and just failing to generate sensible text is just hilarious. it's like a kid learning to write, but still getting the shapes of letters wrong.
throwaway2474 5y ago
Amazing stuff. It’s unfortunate that you have to be a famous blogger to get access to this. It’s been said enough at this point but it really goes against the spirit of OpenAI and what they ostensibly stand for.
- techdragon 5y ago
  And that it’s crippled to be prevent expressions of concepts of violence, politics, or sexuality. Making it the worlds most advanced clip art generator instead of a revolutionarily powerful tool for artistic expression. And before anyone even says it… obviously they have to try and prevent child porn. That’s settled US Law with regards to artistic depictions of underage sex. However everything else they are preventing (and would ban you for if they caught you deliberately found a way to trick it into producing) is protected artistic expression under freedom of speech, first amendment stuff.
  - AnonMO 5y ago
    A true artist can express themselves without violence, politics, or sexuality. Art is about using the tools available to you and creating art. michelangelo didn’t have cad or 3d modeling programs, but he created great sculptures using the tools available to him.
    - techdragon 5y ago
      It’s all well and good to mention great artists and such. But it’s a bad comparison, this is about a tool that is conceptually limited, it’s something art has never had before. We didn’t have paint brushes that wouldn’t let you use them to paint a nude portrait or spray cans that refused to let you use them do create graffiti. This artistic tool is built to prevent you trying to create content containing certain concepts which is a fundamental new factor in how artistic tools shape the art that is created with them. And in case my viewpoint isn’t clear, I don’t think it’s a good thing, and that we should not allow it to become normal. I don’t object to its existence, because I understand corporate politics and how it leads to this. But this sort of crippled tool has all the concerning potentials of “newspeak” in Orwell’s 1984, except to art not to language.
assbuttbuttass 5y ago
I find it very interesting that the AI can't do hands well. If you've ever tried to look at your hands in a dream, it's a startlingly similar effect.
bigmattystyles 5y ago
This is step onto the holodeck and ask the computer for a scene - 300 years ahead of schedule!
ThePerfectLink 5y ago
Man, I would love to use this in a game that procedurally generates events
- bricemo 5y ago
  Have you tried https://aidungeon.io/ https://aidungeon.io/? It creates novel events with GPT-3. I'm sure some gamedev will add DALL-E for visuals to a game eventually.
  - vintermann 5y ago
    I (and many others) have kind of soured on that one after the authors' actions. First off, he fine-tuned the model on text from an online writing/fan fiction site without permission at all. That would in itself be dodgy enough, but if you know anything about these sites, you know there's a lot of pretty dubious sexual stuff there. And it's not as if he didn't know, because he used only a subset of the stories, he must have picked them himself. But then, when the AI started generating stuff that would be illegal if it had pictures and OpenAI caught wind of it, he blamed his users, threw them to the wolves to stay in good standing with openAI. He would even ban people for what the model did, i.e. even if their prompt had nothing sexual in it, you could get banned for the smut-finetuned AI taking the story in that direction on its own. Anything based on OpenAI is going to run into situations like these, they are terrified of bad PR.
dmitriid 5y ago
People should try Rimworld's generative art descriptions with this.
RoboTeddy 5y ago
I wonder what happens if you ask it to draw a self-portrait
skupig 5y ago
I wonder how many elements are copied verbatim from the input images. Obviously, it's all synthesized from existing images, but some of these have regions that are particularly suspect to me: https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/bcfa5ac8da01b78b31003075b27173a0d4049fc03b60370c.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/bcf... https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5c84b38dfe49730d29c3be81f744c7f4e333a046381f1e1a.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5c8... DALL-E definitely does not encode the mechanics of cloth and yet there are regions of perfectly consistent geometry and lighting in the clothing wrinkles. I have a strong suspicion once these models start getting into mainstream hands it's not going to be uncommon for people to find the input photos that were copied. What do we do when a popular image from DALL-E turns out to be an artist's existing creative work with a style transfer applied?
- recuter 5y ago
  The AI maximalists simply refuse to entertain this possibility. The most interesting thing about DALL-E is its understanding of the prompt, objects, concepts and scenes. Which has improved significantly but is still very far from perfect. The rest is a rorschach test that abstracts the flaws away. I'd be almost as impressed with it if it spewed out stick figures. In fact I wish it had an unstylized mode, so one can more clearly see and think about the way it composites things.
  - simonh 5y ago
    Quite, focusing on the artistic merit or quality of the visual elements is missing the point. These are collages. What's interesting is the comprehension and interpretation of the prompts, the way the meaning of the visual elements is understood, and that they are composed in semantically appropriate ways. Having said that the way the visual elements are integrated together without painfully obvious seams or blurring is impressive.
    - recuter 5y ago
      Many of the images, which are not as cherry picked as the ones promoted when DALL-E 2 was announced, exhibit obvious seams when looking closely. Sometimes it works out and sometimes it doesn't. A lot of the ones that work out actually seem OKish because the obvious flaws could be considered forms of "artistic expression". In art there are no mistakes, only happy accidents.
kauguste281 5y ago
Can anybody explain "Gollum writes his autobiography"[1]? The images themselves look extremely well "rendered", good lighting and all and they capture the description quite well. But the "Gollum" in the images doesn't look like any common version of Gollum I could find. Google Image Search and most other places are completely flooded with the movie version of Gollum, which looks very different. There are animated versions that look a little closer, but nothing I could find looks like the images produced by the AI. I'd love to search through the training data to figure out what is going on here, but apparently that isn't public available either. [1] https://twitter.com/Merzmensch/status/1513611885576347658 https://twitter.com/Merzmensch/status/1513611885576347658
- ShamelessC 5y ago
  They did some filtering to make it difficult to generate certain things like people, celebrities, nsfw, etc. This has unpredictable consequences on downstream tasks, particularly if the filtering is aggressive and removes false positives.
- recuter 5y ago
  Yes, here is a possible explanation: it face swaps. Some observations: Note that the writing utensil is always in the right hand. It is more evident after the first image that it is neither a pen or a feather or anything like that but a whispy blurry line that goes nowhere. The book pages are always blank. All the creatures are green and in the same pose. The arms are wrong and often disconnected from the hands. I believe the way to look at DaLL-E 2 output is to break the prompt and the resulting image into distinct concepts/layers. Each layer is cribbed from some pre-existing image. Hands from here, arms from there, head from Yoda, swap the face. Blur everything together with a style transfer.
- RugnirViking 5y ago
  Gollum is presumably considered conceptually close to goblin. All of these are clearly goblins.
larodi 5y ago
Woah, plenty of fresh NFT material :) Go mint and sale, big business ahead ! Will sale like "some original DALL-E images, be the first to own this unique AI art"
asdf12ghjk 5y ago
una oveja subida a un patinete
asdf12ghjk 5y ago
oveja subida a un patinete
TxProgrammer 5y ago
This is remarkable. What are the implications for the human generated art and entertainment world? Combining these technologies and the cycle of progress will we soon (lets say within 2 decades) be able to: 1. Generate music (e.g https://openai.com/blog/jukebox https://openai.com/blog/jukebox) 2. Generate CGI 3D Models (e.g https://www.louisbouchard.ai/ganverse3d/ https://www.louisbouchard.ai/ganverse3d/) 3. Generate Plots/Fiction (this is probably the most complex unknown, e.g https://medium.com/the-research-nest/interesting-novels-written-by-artificial-intelligence-d407e330fe07 https://medium.com/the-research-nest/interesting-novels-writ...) 4. Generate Animation (e.g. https://getrad.co/ https://getrad.co/ or https://www.deepmotion.com/Animate-3D https://www.deepmotion.com/Animate-3D) Finally will a next generation Spielberg be able to create a complete film using these tools sometime in the near future.. FUTURE AI: generate the film "E.T. as a comedy with a female protagonist, and the alien should look like a yoda, set in the 1960s" -or maybe we upload a film script and the AI will generate the movie in "Spielberg style, or Scorsese Style etc"... finally the porn implications are worrying.. how will we ever control this?
deleted 5y ago
[deleted]
deleted 5y ago
[deleted]
Bjarnee 5y ago
Could DALL-E 2 be used to make a series of images of the same character doing different things? Like, if you wanted to make a childrens book about Bobby the 7-eyed giraffosaur's trip to the store, it would be weird if the character looked different on each page.

298 points by nahuel0x 5y ago

I wonder how it would do with more technical engineering drawings, like shop drawings for machinists or blueprints for a building.

bobbyi 5y ago

What's the reason for the restriction on sharing images with faces?

BlueTemplar 5y ago
I assume the risk of giving the possibility of generating "person of group X doing something bad" ? Or more prosaically, we're MUCH better at noticing something wrong in humans (especially faces !) than in, say, puppies, so that would make DALL-E 2 look bad to an uninformed observer.
- gwern 5y ago
  It's the PR risk. You can easily pass the 'look good to an uniformed observer' test with human faces. Remember, faces were something GANs were doing near-flawlessly back as far as ProGAN all the way back in the dark ages of late 2017. (Then StyleGAN did non-photograph faces, like anime - see my ThisWaifuDoesNotExist for a demo of that.) Doing them as part of a larger composition, where the face is a small part of the images and may vary much more than in closeup centered portraits, is harder, but take a look at how Facebook's DALL-E rival Make-A-Scene does it: https://arxiv.org/abs/2203.13131#facebook https://arxiv.org/abs/2203.13131#facebook They specially target faces as part of the training process, with face-specific detectors/losses, and so the faces come out great.
  - BlueTemplar 5y ago
    Fair enough, but it could be... both ! Since you know that training for photo-realistic faces is going to take extra effort, and that you're not going to allow them - you could just spare that effort ! (Or maybe leave it for later, if the network is flexible enough ?)
probably_wrong 5y ago
My theory is that the model would not generate new faces, but rather "copy-paste" faces it has seen in training. Therefore, if someone generates "famous person doing bad thing" and publish the results there's a non-insignificant chance of a lawsuit. And even if the person is not famous, putting someone's picture on an image could very well be a privacy violation in many jurisdictions.

globuous 5y ago

This is just insane. The image to the prompt "A dog looking curiously in the mirror, in digital style" shows a cat looking into a mirror and seeing a dog as itself! Although very creative and "objectively funny" (may cat is like a dog!!!), I think the AI understood "A dog looking curiously (is) in the mirror". These poems are absolutely hilarious also, it's photo-realistic, but the messages make no sense, though the fonts look so perfect! That's where you know it's clearly AI generated ^^ For now.... Sometime soon it looks like realistic pictures of protests are going to be so easy to generate with arbitrary text

BlueTemplar 5y ago
Your comment is going to be misinterpreted without the context : DALL-E 2 failed all the "X looking curiously in the mirror, but the reflection is Y" tests - showing X as the reflection instead, Dave Orr had to do some "hinting/editing" to achieve this : > Here's one where I edited out the cat in the mirror and changed the prompt to be about a dog, and it did something sensible.
sharperguy 5y ago
Gramatically speaking, shouldn't it be "dog looking curiously _into_ a mirror"?

slig 5y ago

Any ideas on how is this going to be priced? Will this model be open just like the GPT-3?

cromwellian 5y ago

"Attention is all you need" was published only 5 years ago in 2017. BERT in 2018, GPT-3 in 2020. Now DALL-E, PaLM, LaMDA, etc. The pace of AI progress is frighteningly fast. I really thin it's plausible that by 2030, AI is writing and debugging most code, and engineers basically become spec writers who manipulate prompts, generate code, and verify. Essentially, project managers whose "team" is a bunch of LLMs. It really doesn't seem we've hit diminishing returns on LLM model size yet, and that's not accounting for the multi-input types where video, text, audio, and more are being fused together.

ummwhat 5y ago
Ya stupid sons of bitches, you automated everyone else out of a job and then you gone done it to yourselves too!
- CryptoPunk 5y ago
  Every higher level language, library and framewok automates coding. But the result is more complex programs, not fewer developers. That's a microcosm of the effect of automation on the economy as a whole.
  - ummwhat 5y ago
    90% of work used to be farming. Today 10% of people are farmers. The next big thing was factory work. At first looms meant more textiles, not less workers. But eventually we hit the transition point where there's actually less factory workers. Now we've moved on to "knowledge work". Sure the effects of automation make more complex knowledge products and jobs for now, but once the automation becomes advanced enough, jobs in the field go down not up. So what comes after knowledge work? We can't have it both ways. We can't pretend like automation will never kill our jobs while simultaneously pursuing the dream of permeant vacation through automation. The very goal of automation contradicts the idea that we would and should always have jobs.
    - CryptoPunk 5y ago

mensetmanusman 5y ago

Shutter-stock will be dead, crazy.

icey 5y ago

The text this generates reminds me of the kind of text you'd see in a dream. The images look real enough, and the text looks like words; but totally unreadable. Kind of an uncomfortable feeling.

junga 5y ago
I think I've never read text while dreaming.
- nikonyrh 5y ago
  That, and looking at a clock is a great way to check whether you are in a dream or not.
- aetherson 5y ago
  I have. You can read things while dreaming. Individual words are fine. But, just like dreams themselves, if you read more than a sentence or two, your mind will be unable to really keep a plot. And if you look away and read again, the text will have changed.
jtsiskin 5y ago
I don’t think this is a coincidence
bryans 5y ago
It's fascinating that the system is able to generate such precise imagery, yet can't handle words at all -- it can only barely reproduce words you explicitly tell it to. But sometimes it'll adds words when you're really not expecting it, and like you said, it's uncomfortable. Like the worst uncanny valley I've ever experienced. It was so unsettling to see the "four seasons" and "periodic table" that I couldn't stop nervously laughing.
- TuringTest 5y ago
  I think the words examples provide insight into how the image generation works at several levels. You can clearly see [1] how the glyphs are created by approximately merging several letters in one place to create a new symbol, while maintaining the overall structure of words and paragraphs within a well-composed layout in the page. The periodic table [2] seems to be doing the same, where the layout is the structure of colored boxes and two sizes of letters within them. Image composition seems to be doing something similar, learning to associate concepts with their visual representations at the right level, and merging already-seen examples in the right proportions to create a novel image. Cats and vampires are represented by their distinctive features, arms and legs are correctly positioned as parts of the body according to the action they perform, and instructions of style (either by artists like "Pieter Brueghel", art styles like "digital" or "mosaic", or even camera settings like ISO exposure [3]) are translated into lower level pixel representations of color, shapes and shadowing. My hypothesis is that if you included examples where the letters are taught one by one, like in kindergarten primers, it may be able to learn those concepts as well and generate better painted text (although I'm not sure it could make the jump to "understanding" the relation between their role as input instructions and as output image text). [1] https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/855638801ffcab0188609438f8c5e20aae809d060078a505.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/855... [2] https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/15713cb1e41bc072449c572342d5c2767d1b5f586afe11bb.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/157... [3] https://www.bramadams.dev/projects/dalle-tricks#let-there-be-lighting https://www.bramadams.dev/projects/dalle-tricks#let-there-be...

neoneye2 5y ago

Incredibly good. Wow

e2le 5y ago

Very impressive. I'm left wondering whether DALL-E 2 could be used to generate furry erotica, among other things.

gwern 5y ago
No, almost certainly not - it's very heavily censored. So far I haven't seen anyone successfully generate anything you could call erotica. (One interesting consequence: the anime is not very good and it can be a struggle to generate anime at all https://www.reddit.com/r/AnimeResearch/comments/txvu3a/anime_x_dalle_2_thread/ https://www.reddit.com/r/AnimeResearch/comments/txvu3a/anime... ) If you mean just could such a model architecture be trained to generate furry erotica? Yes. Erotica, and furry art in general, in Tensorfork's experience, tends to be somewhat harder than regular images because of the more chaotic placement of everything such as limbs, but not that much harder. You might need half again as much compute to get equivalent quality results, perhaps, but probably not, like, 10 times as much.
- astrange 5y ago
  If this is the same old CLIP model, I tried making anime with CLIP+GANs (usual prompt "chitanda from the anime hyouka") and it got the hair color right but nothing else - seemed to have first page of Google Image Search level knowledge. There have to be a lot of limits once you get far enough out of its training data. Even if you could guide it by image prompts, it has to know what that image is meant to represent. Also what most people mean by "anime style" isn't anime style, of course - they actually want one of Avatar-type cartoons, advertising key visuals, game characters, or pixiv/DeviantArt fanart. None of that is drawn the same way as TV anime.
  - ShamelessC 5y ago
    They trained a new noise-aware one on the same dataset, I believe. The CLIP is frozen though in the second stage where they train on a cleaner dataset for the image generation via diffusion conditioned on a CLIP image embed. They get the image embed from another model that can predict image embeds from text embeds to encourage generalizing when sampling. It does suffer from some of the same issues with binding attributes and counting stuff, as far as I can tell. But that's not necessarily related to its ability to compose concepts.

cwkoss 5y ago

I hope they aren't planning on selling the version which can generate realistic faces to regimes manufacturing propaganda.

anothernewdude 5y ago
Regimes manufacturing propaganda have cheaper ways of generating realistic faces.
astrange 5y ago
Modern uses of propaganda don't seem to need it to be believable to work.
- astrange 5y ago
  Whoops, edit period closed. You can effectively use it to make it sound like every other side is unbelievable, or just to tire people into giving up, or get past spam filters by generating better than ever nonsense. And the in-group will take it as a point of pride to believe lies from their own group anyway.
  - cwkoss 5y ago
    I think the bigger danger is the speed that people will be able to fabricate 'evidence' to support a false narrative faster than photographs of an event can come in. The first images of a news story available could be fabrications. What if news organizations were able to put pictures of Saddam's WMDs (that remember, never existed) on frontpage stories while the executive was trying to manufacture consent for entering a war? I feel like the human brain is going to have a hard time being skeptical of fake news when fabricated fantasies can be rendered realistically.
    - vintermann 5y ago
      > What if news organizations were able to put pictures of Saddam's WMDs (that remember, never existed) on frontpage stories while the executive was trying to manufacture consent for entering a war? Then the outcome would be... exactly the outcome we had anyway, which was the OP's point. You can already lie with images with Photoshop. It's a little more work, but you can probably still hide it far better than you can pass off a DALL-E generated image as real. Lying with images isn't the problem. Telling a consistent lie, getting all the details right even when new evidence comes in, that's a problem, and this sort of AI doesn't help with that at all.

andy_ppp 5y ago

AI is some weird infinite mirror to existence. I think we will give birth to general artificial intelligence at some point but I’m thinking it might be stranger than we can possibly comprehend.

mikelemmon 5y ago

Maybe it's sarcasm, but the author seems to downplay these images. Are we really that jaded? This seems like criticizing a dog that learned to speak only basic english...the fact that any of this is even possible is stunning.

bricemo 5y ago
I agree. I could not be more blown away if a real UFO landed and aliens introduced themselves. A week ago all of this was impossible.
- garbagetime 5y ago
  To people paying close attention, these results are unsurprising. The author is simply accurately assessing the novelty of the results. edit: fixed typo
- nil-sec 5y ago
  This isn’t true, the quality of images generated by DALL-E are really good, but they are an incremental improvement and based on a long chain of prior work. See e.g. https://github.com/CompVis/latent-diffusion https://github.com/CompVis/latent-diffusion
  - gwern 5y ago
    Also Make-A-Scene, which in some ways is noticeably better than DALL-E 2 (faces, editing & control of layout through semantic segmentation conditioning): https://arxiv.org/abs/2203.13131#facebook https://arxiv.org/abs/2203.13131#facebook
joe_the_user 5y ago
Just about all the AI achievements are really impressive in the talking dog quality as you say. The thing is that current has been producing more and more things that stay at the talking dog level (as well as other definitely useful things, yes). So the impressiveness and the limits are both worth mentioning.
5y ago

jabthedang 5y ago

dean177 5y ago

I found the images with gibberish text to be unsettling, it reminded me of the mimic creature at the end of Annihilation. This is amazing, I wish I could play with it.

CarrieLab 5y ago

DALL-E 2 is a true "holy shit" moment for me. It's actually hard to believe it's real.

PheonixPharts 5y ago
It's interesting because for me it's the opposite. I feel DALL-E 2 is the clear evidence that we're headed for the next AI-Winter soon. Don't get me wrong, DALL-E is remarkable. But it's remarkable in almost the exact same way ELIZA was remarkable in 1966, and Markov Chain generative models were in the 1990s. All of these, given the context computational powers at the time, were both miracles and parlor tricks at the same time. The trouble is that these demos are impressive, but not much has changed in how the world works. I work in AI/ML and every places I've seen the practical applications of these techniques has ranged the equivalent to adding sprinkles on a cake, to completely useless engineering nightmares that would ultimately create more value with their removal. Yea, a 3.5 billion parameter model is neat, but we know that in 1970 when we couldn't imagine training such a thing. The problem is that we've made essentially no progresses other than showing when you pour incredible human and physical resources into a pot the result looks cool. But when you do the accounting, and ask yourself "what has really changed with all these fantastic innovations in machine learning" the answer is surprisingly little. Dall-E 2 is the type of cool that will be figure 12-3 in a undergrad textbook in 20 years. Students will go "oh that's cool" and turn the page.
- nl 5y ago
  20 years ago we couldn't imagine doing visual search that worked in any way. Now we can do that in a model that runs locally on your phone. This is a pretty big deal.
- nahuel0x 5y ago
  I think you are totally, totally wrong. This is a turning point. Artificial Imagination is just going to revolutionize all content generation, arts and designing. It will expand to video/VR generation and the input prompts probably will came from realtime neurofeedback. And not to mention what fantastic tool will become to explore the humanity collective unconscious and our fundamental nature. In some way is reifying our hive mind.

astrange 5y ago

The cards that aren't cards in "dogs playing poker" look like the wrappers booster packs for CCGs come in. The inability to spell words is because they're using BPE instead of actual text inputs, so it doesn't actually know that words are made out of letters.

fastball 5y ago
I dunno, the networks are sophisticated enough to make anatomically correct things, seems like it would make sense for real english words to crop up as well unless OpenAI deliberately nerfed that.

Trackmal 5y ago

I am stunned by these results and I find it absolutely amazing, but somehow this also makes me kind of sad. So many things we consider worth learning are loosing their value with these advances. It really makes me think if I should stop trying to improve my skills, because in maybe 20 years there is not much left what can not be done better by a machine. :/

mmcconnell1618 5y ago
DALL-E has been trained in the styles of creative humans. It can mashup the content that it has been fed but I haven't seen it create a new style of artwork like impressionism or pop art that it hadn't already seen as examples. It also has no understanding of what is generated. We are impressed as human observers because it appears to understand the task we presented.
- gfodor 5y ago
  How many hours have you spent working with it so far? You obviously have a lot of experience with it, so I’m wondering how you drew this conclusion.
  - mmcconnell1618 5y ago
    Zero. But I did read the research paper, web site and viewed the web site mentioned in this hacker news post along with the samples. I've worked with lots of machine learning models and tools and understand the underlying design of the system. You can't ask Dall-E to create a pop art picture of Corgis if you didn't train it on images of Corgis and pop art. I'm not downplaying the achievement of the system that creates an incredible connection between the input images and the text descriptions. But.. at the end of the day. It is not creative in the same way humans are creative.
    - gfodor 5y ago
      That’s just begging the question. We don’t know if DALL-E is creative in ways isomorphic to humans. It might be. How would one go about structuring a hypothesis? Have you read the original DALL-E paper? Worth considering: https://arxiv.org/abs/2112.04035 https://arxiv.org/abs/2112.04035

gfodor 5y ago

Kurzweil was too conservative. This is the last decade of humanity, as we understand it today.

amcaskill 5y ago

This line stuck out for me: > I tried to ask for Dall-E by name but that was a content policy violation. It seems like they are trying to prevent it from visualizing “itself”. Is there a less exciting explanation?

nighthawk454 5y ago
less exciting: they put their brands in the blacklist they wouldn't want Dall-E's name plastered next to some harmful/offensive content. or generate uncontrolled PR from stupid meme articles. wouldn't be a bad idea to chuck all the companies names/brands in there. wouldn't be surprised if "OpenAI" and "GPT-3" are banned too. based on the comments, the policy violations cover a lot of territory - covid, explosive, nuclear war. one commenter said that "glass of guidelines" violates the policy, which is a nonsensical statement. suggesting either "guidelines" is a banned word. Or, maybe they have a content policy classifier, in which case a bunch of random stuff will probably trigger it. _for sure_ they're not worried the "AI might visualize itself", that's not really a thing
- amcaskill 5y ago
  Right right, PR risk, not AI safety risk. Of course, that makes way more sense.

abdusco 5y ago

dall-e trying really hard and just failing to generate sensible text is just hilarious. it's like a kid learning to write, but still getting the shapes of letters wrong.

throwaway2474 5y ago

Amazing stuff. It’s unfortunate that you have to be a famous blogger to get access to this. It’s been said enough at this point but it really goes against the spirit of OpenAI and what they ostensibly stand for.

techdragon 5y ago
And that it’s crippled to be prevent expressions of concepts of violence, politics, or sexuality. Making it the worlds most advanced clip art generator instead of a revolutionarily powerful tool for artistic expression. And before anyone even says it… obviously they have to try and prevent child porn. That’s settled US Law with regards to artistic depictions of underage sex. However everything else they are preventing (and would ban you for if they caught you deliberately found a way to trick it into producing) is protected artistic expression under freedom of speech, first amendment stuff.
- AnonMO 5y ago
  A true artist can express themselves without violence, politics, or sexuality. Art is about using the tools available to you and creating art. michelangelo didn’t have cad or 3d modeling programs, but he created great sculptures using the tools available to him.
  - techdragon 5y ago
    It’s all well and good to mention great artists and such. But it’s a bad comparison, this is about a tool that is conceptually limited, it’s something art has never had before. We didn’t have paint brushes that wouldn’t let you use them to paint a nude portrait or spray cans that refused to let you use them do create graffiti. This artistic tool is built to prevent you trying to create content containing certain concepts which is a fundamental new factor in how artistic tools shape the art that is created with them. And in case my viewpoint isn’t clear, I don’t think it’s a good thing, and that we should not allow it to become normal. I don’t object to its existence, because I understand corporate politics and how it leads to this. But this sort of crippled tool has all the concerning potentials of “newspeak” in Orwell’s 1984, except to art not to language.

assbuttbuttass 5y ago

I find it very interesting that the AI can't do hands well. If you've ever tried to look at your hands in a dream, it's a startlingly similar effect.

bigmattystyles 5y ago

This is step onto the holodeck and ask the computer for a scene - 300 years ahead of schedule!

ThePerfectLink 5y ago

Man, I would love to use this in a game that procedurally generates events

bricemo 5y ago
Have you tried https://aidungeon.io/ https://aidungeon.io/? It creates novel events with GPT-3. I'm sure some gamedev will add DALL-E for visuals to a game eventually.
- vintermann 5y ago
  I (and many others) have kind of soured on that one after the authors' actions. First off, he fine-tuned the model on text from an online writing/fan fiction site without permission at all. That would in itself be dodgy enough, but if you know anything about these sites, you know there's a lot of pretty dubious sexual stuff there. And it's not as if he didn't know, because he used only a subset of the stories, he must have picked them himself. But then, when the AI started generating stuff that would be illegal if it had pictures and OpenAI caught wind of it, he blamed his users, threw them to the wolves to stay in good standing with openAI. He would even ban people for what the model did, i.e. even if their prompt had nothing sexual in it, you could get banned for the smut-finetuned AI taking the story in that direction on its own. Anything based on OpenAI is going to run into situations like these, they are terrified of bad PR.

dmitriid 5y ago

People should try Rimworld's generative art descriptions with this.

RoboTeddy 5y ago

I wonder what happens if you ask it to draw a self-portrait

skupig 5y ago

I wonder how many elements are copied verbatim from the input images. Obviously, it's all synthesized from existing images, but some of these have regions that are particularly suspect to me: https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/bcfa5ac8da01b78b31003075b27173a0d4049fc03b60370c.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/bcf... https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5c84b38dfe49730d29c3be81f744c7f4e333a046381f1e1a.png/w_1024 https://39669.cdn.cke-cs.com/rQvD3VnunXZu34m86e5f/images/5c8... DALL-E definitely does not encode the mechanics of cloth and yet there are regions of perfectly consistent geometry and lighting in the clothing wrinkles. I have a strong suspicion once these models start getting into mainstream hands it's not going to be uncommon for people to find the input photos that were copied. What do we do when a popular image from DALL-E turns out to be an artist's existing creative work with a style transfer applied?

recuter 5y ago
The AI maximalists simply refuse to entertain this possibility. The most interesting thing about DALL-E is its understanding of the prompt, objects, concepts and scenes. Which has improved significantly but is still very far from perfect. The rest is a rorschach test that abstracts the flaws away. I'd be almost as impressed with it if it spewed out stick figures. In fact I wish it had an unstylized mode, so one can more clearly see and think about the way it composites things.
- simonh 5y ago
  Quite, focusing on the artistic merit or quality of the visual elements is missing the point. These are collages. What's interesting is the comprehension and interpretation of the prompts, the way the meaning of the visual elements is understood, and that they are composed in semantically appropriate ways. Having said that the way the visual elements are integrated together without painfully obvious seams or blurring is impressive.
  - recuter 5y ago
    Many of the images, which are not as cherry picked as the ones promoted when DALL-E 2 was announced, exhibit obvious seams when looking closely. Sometimes it works out and sometimes it doesn't. A lot of the ones that work out actually seem OKish because the obvious flaws could be considered forms of "artistic expression". In art there are no mistakes, only happy accidents.

kauguste281 5y ago

Can anybody explain "Gollum writes his autobiography"[1]? The images themselves look extremely well "rendered", good lighting and all and they capture the description quite well. But the "Gollum" in the images doesn't look like any common version of Gollum I could find. Google Image Search and most other places are completely flooded with the movie version of Gollum, which looks very different. There are animated versions that look a little closer, but nothing I could find looks like the images produced by the AI. I'd love to search through the training data to figure out what is going on here, but apparently that isn't public available either. [1] https://twitter.com/Merzmensch/status/1513611885576347658 https://twitter.com/Merzmensch/status/1513611885576347658

ShamelessC 5y ago
They did some filtering to make it difficult to generate certain things like people, celebrities, nsfw, etc. This has unpredictable consequences on downstream tasks, particularly if the filtering is aggressive and removes false positives.
recuter 5y ago
Yes, here is a possible explanation: it face swaps. Some observations: Note that the writing utensil is always in the right hand. It is more evident after the first image that it is neither a pen or a feather or anything like that but a whispy blurry line that goes nowhere. The book pages are always blank. All the creatures are green and in the same pose. The arms are wrong and often disconnected from the hands. I believe the way to look at DaLL-E 2 output is to break the prompt and the resulting image into distinct concepts/layers. Each layer is cribbed from some pre-existing image. Hands from here, arms from there, head from Yoda, swap the face. Blur everything together with a style transfer.
RugnirViking 5y ago
Gollum is presumably considered conceptually close to goblin. All of these are clearly goblins.

larodi 5y ago

Woah, plenty of fresh NFT material :) Go mint and sale, big business ahead ! Will sale like "some original DALL-E images, be the first to own this unique AI art"

asdf12ghjk 5y ago

una oveja subida a un patinete

asdf12ghjk 5y ago

oveja subida a un patinete

TxProgrammer 5y ago

This is remarkable. What are the implications for the human generated art and entertainment world? Combining these technologies and the cycle of progress will we soon (lets say within 2 decades) be able to: 1. Generate music (e.g https://openai.com/blog/jukebox https://openai.com/blog/jukebox) 2. Generate CGI 3D Models (e.g https://www.louisbouchard.ai/ganverse3d/ https://www.louisbouchard.ai/ganverse3d/) 3. Generate Plots/Fiction (this is probably the most complex unknown, e.g https://medium.com/the-research-nest/interesting-novels-written-by-artificial-intelligence-d407e330fe07 https://medium.com/the-research-nest/interesting-novels-writ...) 4. Generate Animation (e.g. https://getrad.co/ https://getrad.co/ or https://www.deepmotion.com/Animate-3D https://www.deepmotion.com/Animate-3D) Finally will a next generation Spielberg be able to create a complete film using these tools sometime in the near future.. FUTURE AI: generate the film "E.T. as a comedy with a female protagonist, and the alien should look like a yoda, set in the 1960s" -or maybe we upload a film script and the AI will generate the movie in "Spielberg style, or Scorsese Style etc"... finally the porn implications are worrying.. how will we ever control this?

deleted 5y ago

[deleted]

deleted 5y ago

[deleted]

Bjarnee 5y ago

Could DALL-E 2 be used to make a series of images of the same character doing different things? Like, if you wanted to make a childrens book about Bobby the 7-eyed giraffosaur's trip to the store, it would be weird if the character looked different on each page.