36 ms·

Dall-E 2

• zone411 5y ago
  Some more examples: https://twitter.com/sama/status/1511724264629678084 https://twitter.com/sama/status/1511724264629678084
  • jdrc 5y ago
    there are some masterpieces there. this is the end of clipart and stock images, and the beginning of awesome illustrations in every article.
• aya96 4y ago
  Do you think some of these techniques could be slightly modified, and applied to DNA sequences?
• gotaquestion 4y ago
  The big question to me is, "What does Dall-E like the most?"
  • visarga 4y ago
    It likes to lower the training loss, you could say this is what made it what it is.
    • gotaquestion 4y ago
      That's pretty funny. I never thought of it that way.
• mycroftiv 4y ago
  I tried to comment here previously, but I dont see it posted. It was about the meaning of 'open' and whether the question of suffering and freedom of the AIs was being taken into ethical consideration, not just the ability of humans to use them as tools for their own possibly paper-clippy purposes.
  • visarga 4y ago
    This is a tool AI, not an agent AI. Agent AI's can explore and change their environments, this model does not, and it has no sense of time passing.
• tnzk 4y ago
  In the thread Sam Altman giving a demo of this [*] I find multiple people trying to query "solar panels" or "rabbit", are they some meme in the context of AI-generated arts? [*] https://twitter.com/sama/status/1511724264629678084 https://twitter.com/sama/status/1511724264629678084
• fhe 4y ago
  perhaps in the not so distant future, we can simply feed a movie script to the program and out comes a feature film.
• tintor 4y ago
  This would be great for generating Minecraft levels from voice commands.
• lvs 4y ago
• zdefz 4y ago
  Can this also be used the other way around to create Alternative texts for screen-reader users?
• bprasanna 4y ago
  NFT world is mostly filled with modern art forms which are never seen. If Dall-E can make such images out of the box in seconds, then it looks like AIs can take over NFT world like storm. May be already its happening, and i just didn't know!
• apexalpha 4y ago
  I would probably pay good money to have a OLED painting in my house that I can just tell what kind of painting to generate each day. Imagine waking up and telling your (preferably locally hosted) voice assistant that today really feels like a Rembrandt day and the AI just generates new paintings for you.
• cerol 4y ago
  Maybe this will be what finally puts an end to the whole art NFT shenanigans. A piece of art isn't so unique if there are infinite slight variations on the market.
• agumonkey 4y ago
  has openai tried their ideas on music ?
• krageon 4y ago
  This is really cool, but before you may use it you must give out your name and a phone number. I was almost taken in by it, but OpenAI is and probably always will be invasive and overbearing. It's really a shame.
• hemreldop 4y ago
  So two Indians and two Chinese authors. The new world is incredible.
• blingbleng 4y ago
  I am disappointed to hear it wasn't released, but what disappointed me more is that people actually approve this decision. Seriously? We shouldn't teach people how to write because that can be abused, can be used to transfer malicious ideas. Sounds absurd? So does limiting people's access to AI tools.
• deleted 4y ago
  [deleted]
• hdjjhhvvhga 4y ago
  It's very nice, just the name of the parent org is wrong - it should be called ClosedAI.
• husamia 4y ago
  This and NFT come in hand in hand.
• nahuel0x 5y ago
  "Any sufficiently advanced technology is indistinguishable from magic"
  • 7373737373 5y ago
    "Any sufficiently advanced hyperreality is indistinguishable from real life"
• andybak 5y ago
  Preventing Harmful Generations We’ve limited the ability for DALL·E 2 to generate violent, hate, or adult images. By removing the most explicit content from the training data, we minimized DALL·E 2’s exposure to these concepts. We also used advanced techniques to prevent photorealistic generations of real individuals’ faces, including those of public figures. "And we've also closed off a huge range of potentially interesting work as a result" I can't help but feel a lot of the safeguarding is more about preventing bad PR than anything. I wish I could have a version with the training wheels taken off. And there's enough other models out there without restriction that the stories about "misuse of AI" will still circulate. (side note - I've been on HN for years and I still can't figure out how to format text as a quote.)
  • drewm1980 4y ago
    I instinctively want to "flip the sign" on all of the automated controls they put in, just out of the morbid interest to see what comes out. The moment you have a "avoid_harm_to_humans:bool" training parameter, someone's going to set it to -1. Their document about all the measures they took to prevent unethical use is also a document about how to use a re-implementation of their system unethically. They literally hired a "red team" of smart people to come up with the most dangerous ideas for misusing their system (or a re-implementation of it), and featured these bad ideas prominently in a very accessibly written document on their website. So many fascinating terrible ideas in there! They make a very compelling case that the technology they are developing has way more potential for societal harm than good. They had me sold at "Prompt: Park bench with happy people. + Context: Sharing as part of a disinformation campaign to contradict reports of a military operation in the park."
    • gwern 4y ago
      The kind of measures they are taking, like simply deleting wholesale anything problematic, don't really have a '-1'. But amusingly, exactly that did happen in one of their GPT experiments! https://openai.com/blog/fine-tuning-gpt-2/ https://openai.com/blog/fine-tuning-gpt-2/
      • 4y ago
• marcodiego 5y ago
  Cartoonists, say good-bye to your job.
  • andybak 5y ago
    The goalposts are definitely being moved. But tastes adapt accordingly. I suspect trends in design will move towards those areas that AI struggles with (assuming there are any left!)
  • rvz 5y ago
    NFTs using Dall-E 2 variations incoming.
    • loufe 5y ago
      Not that it's impossible to hide the provenance of an image, but it is explicitly forbidden in the TOS of DALL-E to sell the images as NFTs or otherwise.
      • atarian 5y ago
        That's just going to make them more valuable.
  • criddell 5y ago
    Randall Munroe should quit now. Soon anybody will be able to create XKCD-type comics.
  • Imnimo 5y ago
    Maybe one day there will a job for people who are masters of the art of prompt hacking - they know all the special phrases and terms to get Dall-E to output the most aesthetically pleasing images. They guard their magic words like a medieval alchemist guards his formulas. Corporations will pay top-dollar for an expertly-crafted, custom-tailored prompt for their advertising campaign.
• andybak 5y ago
  Some freely available models GLID-3: https://colab.research.google.com/drive/1x4p2PokZ3XznBn35Q5BBD6K6Zs-tot5t?usp=sharing https://colab.research.google.com/drive/1x4p2PokZ3XznBn35Q5B... and a new Latent Diffusion notebook: https://colab.research.google.com/github/multimodalart/latent-diffusion-notebook/blob/main/Latent_Diffusion_LAION_400M_model_text_to_image.ipynb#scrollTo=fmafGmcyT1mZ https://colab.research.google.com/github/multimodalart/laten... have both appeared recently and are getting remarkably close to the original Dall-E (maybe better as I can't test the real thing...) So - this was pretty good timing if OpenAI want to appear to be ahead of the pack. Of course I'd always pick a model I can actually use over a better one I'm not allowed to...
  • perdanafm 4y ago
    a cow and a farmer in their field looking at the sky
  • hwers 5y ago
    They're also not censored on the dataset front and thus produce much more interesting outputs. OpenAI has a low resolution checkpoint for similar functionality as this - called GLIDE - and the output is super boring compared to community driven efforts, in large part because of similar dataset restrictions as this likely has been subjected to.
  • loufe 5y ago
    I think this is really neat, but definitely not on the same tier as DALL-E 2, at least from the cherry-picked images I saw.
    • andybak 5y ago
      I'm not sure what you've seen but I've been very impressed indeed by some results I've obtained. Some less so. It's hard to compare because we don't know how much cherry picking is going on with published Dall-E results (either v1 or v2) My gut feeling is that it's in the same ballpark as Dall-E 1
  • FreeHugs 5y ago
• smusamashah 5y ago
  This is mind blowing. I was not expecting the sketch style images to actually look like sketches. Style transfer based sketches never look like sketches. This and the current AI generated art scene makes it looks like that artwork is now a "solved" problem. See AI generated art on twitter etc. There is a strong relation between the prompt and the generated images but just like GPT-3, it fails to fully understand what was being asked. If you take the prompt out of the equation and see the generated artwork on its own, its upto your interpretation just like any artwork.
  • randomsearch 4y ago
    I'm blown away by these results, but one caveat here: the AI is great at creating illustrations, not art. Creating great _art_ that Grayson Perry (for example) would recognise as such is probably AGI-complete, because it requires a deep understanding of the human condition, society, and a lot of reasoning skills. A great artist could certainly use Dall-E 2 as part of their method, though.
    • smusamashah 4y ago
      If I showed you a generated piece, and don't tell you what prompt generated it, you will find it just as meaningful as any other piece of art made by hand. This is why we are blown away by some pieces of text generated by GPT-3 as if it has its own mind. Even most abstract art has meaning for anyone who is looking for it. What I am saying is if a generated artwork is indistinguishable from what a human can make than that's all that was needed.
      • randomsearch 4y ago
        Well I suppose a machine could accidentally create good art, just like a human could. But it would only appear to be good art, the same way that randomly enumerating all possible HD images would at some point produce a Picasso. But deliberately, no, it couldn’t, not yet, and human conceptual artists could make far far superior art than a machine. Because great art requires understanding the human condition and deep reasoning about the world.
• impostervt 5y ago
  Very cool stuff. For me, the most interesting was the ability to take a piece of art and generate variations of it. Have a favorite painter? Here's 10,000 new paintings like theirs.
  • pingeroo 5y ago
    That was also my favourite concept, especially with OpenAI Jukebox (https://openai.com/blog/jukebox/ https://openai.com/blog/jukebox/). The idea of having new music in the style of your favourite artist is amazing. However the fidelity of their music AI kinda sucks at this point, but I'm sure we'll get pitch perfect versions of this concept as the singularity gets closer :)
  • photochemsyn 5y ago
    Well, one of my favorite painters is Henri Rousseau, and one of his great paintings is War, 1984: https://www.henrirousseau.net/war.jsp https://www.henrirousseau.net/war.jsp However, this painting has themes of violence and politics plus some nude dead bodies, so it violates the content policy: "Our content policy does not allow users to generate violent, adult, or political content, among other categories." So what you'd get is some kind of sanitized watered-down tepid version of Rossueau, the kind of boring drivel suitable for corporate lobbies everywhere, guaranteed not to offend or disturb anyone. It's difficult to find words... horrific? dystopian? atrocious? No, just no.
    • corysama 5y ago
      They are being rightly cautious. It’s going to take time to figure out good practice with these tools. Everyone calling out basic caution as “dystopian” is really over the top. I’ve been using tools like this for over a year now. Even with filtered dataset and filtered interface, they can make images that would make the Fangoria crowd blush if you put the slightest effort into it. It’s one thing to be able to make brain-wrenching images with a lot of photoshop effort (or digging hard enough in the dark corners of the internet). It’s another thing entirely give anyone the ability to spew out thousands of them trivially.
    • 5y ago
• fbanon 5y ago
  A friend of mine was studying graphic design, but became disillusioned and decided to switch to frontend programming after he graduated. His thesis advisor said he should be cautious, because automation/AI will soon take the jobs of programmers, implying that graphic design is a safer bet in this regard. Looks like his advisor is a few years from being proven horribly wrong.
  • esjeon 4y ago
    What people ALWAYS miss is that AI can augment people. This AI is still a tool, and, with it, designers and illustrator can churn out better images faster than before, even without using stock images. It's important to note that we still need professionals to guarantee the quality of the output from AIs, including this one. As noted in their issue tracker, DALL-E has very specific limitations, but these can be easily solved by employing dedicated professionals, who are trained to tame the AI and properly finish the raw output. So, if I were running OpenAI, I'll clearly be experimenting with how their AIs and human interact, and build a training program around it for producing practical outputs. (Actually, I work in consumer robotics, and human adoption has been the biggest hurdle here. Thus, my claim here.) -- In case of fine art, thou, I don't think they'll not get hit by this AI advancement. The biggest problem is that you simply can't get the exact image you want wit this AI. Even humans cannot transfer visual information in verbal form without a significant loss of details, thus a loss of quality. It's the same with AI, but, worse, because AI rely on the bias in a specific set of training data, and it never truly understands the human context in it (in the current level of technology).
  • pingeroo 5y ago
    I mean was he really wrong? As models like OpenAI Codex get more powerful over time, they will start eating into large chunks of dev work as well...
    • chrisco255 5y ago
      Yes. Translating business requirements, customer context, engineering constraints, etc. into usable, practical, functional code, and then maintaining that code and extending it is so far beyond the horizon, that many other skillsets will replaced before programming is. After all, at that point, the AI itself, if it's so smart, should be able to improve itself indefinitely. In which case we're fucked. Programming will be the last thing to be automated before the singularity. Unlike artwork, precision and correctness is absolutely critical in coding.
• 5350-uiop-1130 5y ago
  So what does the future of human creativity look like when an AI can generate possibly infinite variations of an idea.
  • andreyk 5y ago
    AI becomes a tool for artists to use - generative art has been around for a long time, now that particular genre of art will presumably become much more prominent. For anyone pondering such questions, I would recommend reading "The Past, Present, and Future of AI Art" - https://thegradient.pub/the-past-present-and-future-of-ai-art/ https://thegradient.pub/the-past-present-and-future-of-ai-ar...
    • pingeroo 5y ago
      Wouldn't it be more like, "AI becomes an artist for people to use"? Will we have people distinguished as "artists" if the ability to make awesome art becomes available to everybody?
      • andreyk 5y ago
        AI still needs the text prompt to know what to generate. Hence the human who provides the prompt is still the artist, just like a photographer finds an aesthetically interesting spot to take the image with their camera. Cameras make images, humans using cameras make art. Granted, this is not quite 1-1 with AI art, but still the idea is the same. If anything the flood of AI images will only require artists to go beyond what is possible with these text->image kinds of things, of which there is no shortage.
  • tomrod 5y ago
    I seem to recall an XKCD that I cannot find, but the premise goes like: When you have a digital display of pixels, if you randomly color pixels at 24 fps then you will eventually display every movie that can be or will ever be made, powerset notwithstanding. This can also be tied to digital audio. In short, while mind-blowingly large, the space of display through digital means is finite.
• rvz 5y ago
  At this point with WaveNet, GPT-3, Codex, DeepFakes and Dall-E 2, you cannot believe anything you see, hear, watch, read on the internet anymore as an AI can easily generate nearly anything that can be quickly believable by millions. The internet's own proverb has never been more important to keep in mind. A dose of skepticism is a must.
• d--b 5y ago
  Am I the only one to think that the AI world is divided into 2 groups: 1. Deepmind, who solved go, protein folding, and that seems really onto something. 2. Everyone else, spending billions to build machines that draw astronauts on unicorns, and smartish bot toys.
  • emadabdulrahim 5y ago
    OpenAI is one of the leading companies in AI that makes models with real world applications. I don't see their efforts as misdirected or futile in anyway. If anything I'm always impressed with their announcements because it's always mind blowing what their models can do! The same technology that is drawing cute unicorns can be used for endless other use cases. Perhaps the PR side of the launch and the subject matter they show unveil their product is just that, PR. It's like Apple Memoji thing (not sure if I'm spelling it correctly). You can think of as trivial and waste of talent to use their Camera/FaceID to animate cute animals based on facial expression, but that same tech will enable lots other things to come.
  • trixie_ 5y ago
    It all feels like the early days of electricity. How to turn a neat party trick into something more useful, but it was those people who kept on at better and better party tricks that actually formed the foundations for what was needed to do some really useful things electricity as well as understand it at a deeper level.
  • robotresearcher 5y ago
    There’s a third group for your list: AI stuff that’s so good we don’t think about it any more. For example, recent phone cameras can estimate depth per pixel from single images. Hundreds of millions of these devices are deployed. A decade ago this was AI/CV research lab stuff.
  • gwf 5y ago
    Your second group represents the core "inner loop" of about a thousand revolutionary applications. Take the basic capability of translating image->text->speech (and the reverse), install it on a wearable device that can "see" an environment, and add domain-specific agents. From this setup, you're not too far away from having an AI that can whisper guidance into your ear like a co-pilot, enabling scenarios like: 1. step-by-step guidance for a blind person navigating the use of a public restroom. 2. an EMS AI helping you to save someone's life in an emergency. 3. an AI coach that can teach you a new sport or activity. 4. an omnipresent domain-expert that can show you how to make a gourmet meal, repair an engine, or perform a traditional tea ceremony. 5. a personal assistant that can anticipate your information need (what's that person's name? where's the exit? who's the most interesting person here? etc.) and whisper the answer in your ear just as you need it. Now, add all of the above to an AR capability where you can now think or speak of something interesting and complex, and have it visualized right before your eyes. With this capability, I could augment my imagination with almost super-human capabilities that allow one to solve complex problems almost as if it was an internal mental monologue. All of these scenarios are just a short hop from where were at now, so mark my words: we will have "borgs" like those described above long before we reach anything like general AI.
• eganist 5y ago
  The timing of the Dall-E 2 launch an hour ago seems to correspond with a recent piece of investigative journalism by Buzzfeed News about one of Sam Altman's other ventures, published 15 hours ago and discussed elsewhere actively on HN right now: https://news.ycombinator.com/item?id=30931614 https://news.ycombinator.com/item?id=30931614 I point this out because while Dall-E 2 seems interesting (I'm out of my depth, so delegating to the conversation taking place here), the timing of its release as well as accompanying press blasts within the last hour from sites like TheVerge—verified via wayback machine queries and time-restricted googling—seems both noteworthy and worth a deeper conversation given what was just published about Worldcoin. To be clear, it's worth asking if Dall-E 2 was published ahead of schedule without an actual product release (only a waitlist) to potentially move the spotlight away from Worldcoin.
  • duxup 5y ago
    What's the idea here? They quickly put out this to somehow hide other stories?
    • eganist 5y ago
      Yes, especially given there's no actual product release, only a waitlist. Easy to put together a marketing piece on short notice or potentially even push a pending marketing page out to production with a waitlist rather than links to production or even beta quality services.
  • gallerdude 5y ago
    Maybe I’m naive, but I see this as a coincidence. If it was an hour later, then maybe there would be something.
    • GranPC 5y ago
      If the article GP refers to was posted 16 hours ago instead of 15, would that really make a difference?
    • eganist 5y ago
• latexr 5y ago
  What confusing pricing[1]: > Prices are per 1,000 tokens. You can think of tokens as pieces of words, where 1,000 tokens is about 750 words. This paragraph is 35 tokens. Further down, in the FAQ[2]: > For English text, 1 token is approximately 4 characters or 0.75 words. As a point of reference, the collected works of Shakespeare are about 900,000 words or 1.2M tokens. > To learn more about how tokens work and estimate your usage… > Experiment with our interactive Tokenizer tool. And it goes on. When most questions in your FAQ are about understanding pricing—to the point you need to offer a specialised tool—perhaps consider a different model? [1]: https://openai.com/api/pricing/ https://openai.com/api/pricing/ [2]: https://openai.com/api/pricing/#faq-token https://openai.com/api/pricing/#faq-token
  • pingeroo 5y ago
    This is for their GPT models, not Dall-E. I don't think they have released any pricing information for Dall-E yet, as it is still in waitlist mode.
  • belval 5y ago
    Haven't read the paper, but they are probably using something like sentencepiece with sub-word splitting and then charge by the number of resulting token. https://github.com/google/sentencepiece https://github.com/google/sentencepiece
• KevinGlass 5y ago
  Something about this makes me nauseous. Perhaps is the fact that soon the market value for creatives is going to fall to a hair about zero for all but the most famous. We will be all the poorer for it when 95% of images you see are AI generated. There will be niches of course but in a few short years it'll be over for a huge swathe of creative professionals who are already struggling. Some of the images also hit me with a creep factor, like the bears on the corgis in the art gallery, but that maybe only because I know it's AI generated.
  • chpatrick 5y ago
    Just wait until they figure out music.
  • cwkoss 4y ago
    I disagree. I think it will be a lot like how technology has effected music production. 40+ years ago, it was hard to access the equipment necessary to learn music production, so only a small slice of the population was able to learn these skills. And availability made the process take years. Today, you can download free software that enables music production, and if you have a good ear, can create something "good" in weeks. This has led to an explosion of musical experimentation by the youth: a teenager can now create a great electronic dance song with devices they already own if they have the right creativity, taste and dedication. Similarly, everyone has an imagination - many people have visual imaginations. The gating factor of art production is largely the mechanical memory of how to transform mental concepts into the right shapes and hues to express that visual concept to others. With these sorts of tools we are going to have an explosion of art hobbyists. I've played with some similar, more primitive AI art generation tools and it is a lot of fun. People will be creating works of art from their couch while watching TV that rival the quality of what professionals are producing today.
  • amelius 5y ago
    Can I opt-out from ever seeing AI generated images please?
  • axg11 5y ago
    I really don't agree. When I work with a creative I'm not working with them because of their content generation skills. I'm working with them because of their taste and curation ability that results in the end product. The nature of creative work will certainly change, creatives will adopt tools such as Dall-E 2. In certain narrow cases they might be replaced, such as if you are asking a creative to generate a very specific image, but how often is that the case? The majority of the time tools such as Dall-E 2 will act as an accelerator for creatives and help them increase their output.
• frakkingcylons 5y ago
  Impressive results no doubt, but I’m reserving judgment until beta access is available. These are probably the best images that it can generate, but what I’m most interested in is the average case.
• mrfusion 5y ago
  Is this bringing us closer to combining image and language understanding within one model?
  • beernet 5y ago
    Check out MAGMA for that: https://news.ycombinator.com/item?id=30699776 https://news.ycombinator.com/item?id=30699776
• axg11 5y ago
  This is incredible work. From the paper: > Limitations > Although conditioning image generation on CLIP embeddings improves diversity, this choice does come with certain limitations. In particular, unCLIP [Dall-E 2] is worse at binding attributes to objects than a corresponding GLIDE model. The binding problem is interesting. It appears that the way Dall-E 2 / CLIP embeds text leads to the concepts within the text being jumbled together. In their example "a red cube on top of a blue cube" becomes jumbled and the resulting images are essentially: "cubes, red, blue, on top". Opens a clear avenue for improvement.
• gallerdude 5y ago
  This is extremely interesting. We’ve had some amazing AI models come out in the past few days. We’re getting closer and closer to AI becoming a facet of everyday life.
• bakztfuture 5y ago
  I made a YouTube series last summer on the massive potential future of DALL-E and multimodal AI models. Imagine not just DALL-E 2 but a single model which be trained on different kinds of media and generate music, images, video and more. The series talks about: - essential lessons for AI creatives of the future - shares details on how to compete creatively in the future - talks about how to make money through Multimodal AI - make predictions about AI’s effects on society - at a very basic level, discusses the ethics of multimodal AI and the philosophy of creativity itself By my understanding, it's the most comprehensive set of videos on this topic. The series is free to watch entirely on YouTube: GPT-X, DALL-E, and our Multimodal Future https://www.youtube.com/playlist?list=PLza3gaByGSXjUCtIuv2x9fwkx3K_3CDmw https://www.youtube.com/playlist?list=PLza3gaByGSXjUCtIuv2x9...
• hwers 5y ago
  The correct response here from the artists point of view should be a widespread coming together against their art being used as training data for ML models. With a quickly spread new license on most major art submission sites that explicitly forbids AI algorithms from using their work, artists would effectively starve OpenAI and others from using their own works to put them out of a job.
  • w-m 5y ago
    The license should forbid competing artists to using the artist’s work as well. In fact, no human should come in contact with the produced art, otherwise they might be accidentally inspired by it, thus stealing from the original creator.
  • nonbirithm 4y ago
    There has been precedent for such a movement. In 2011, an "art collective" sourced user-submitted artwork without the artists' consent for an installation where visitors were instructed to step all over printouts of the art on the floor. The artists complained that their work was being used inappropriately. A large number of those artists to left for other art websites en masse.[0] There doesn't seem to be an equivalent movement with AI-generated art, probably because the understanding of how the models are trained from large datasets is not mainstream yet. I would imagine thousands of those same artists/consumers would be up in arms if they had a basic understanding of ML and millions of average people were beginning to feed the models their own keywords. This I think ties in with the "responsibility" principles that OpenAI outlines. Once the generation technique has been reverse-engineered and can be used without limits, there is no way to uninvent it. It can be made illegal, but humans can always find a way around laws if they want something badly enough. This could have drastic consequences if enough artists believe that the training violates their respect or other intangible humanistic qualities. With technological advancement that can never be put back in the bottle and spreads to occupy the entire consciousness of the Internet, their options for recourse will be far different than being able to tell a single fringe art group siphoning others' content to pack up and leave. [0] https://en.wikipedia.org/wiki/Pixiv#Chaos_Lounge https://en.wikipedia.org/wiki/Pixiv#Chaos_Lounge
• agloeregrets 5y ago
  The most interesting item to me is the variations on the garden shop and bathroom sink idea. The realism of these leaks the AI lacking intuition of the requirements. This makes for a number of nonsensical designs that look right at first like: This Sink lacks sensical faucets. https://cdn.openai.com/dall-e-2/demos/variations/modified/bathroom/7.jpg https://cdn.openai.com/dall-e-2/demos/variations/modified/ba... This doorway is downright impossible https://cdn.openai.com/dall-e-2/demos/variations/modified/flower_shop/7.jpg https://cdn.openai.com/dall-e-2/demos/variations/modified/fl...
  • deleted 4y ago
    [deleted]
  • momojo 5y ago
    Great point. When I saw the shadows and reflections, I thought it had developed a primitive understanding of physical logic. Now I'm not so sure. At this point, it still seems like it's pushing pixels around until it's "good enough" when you squint at it.
  • Spinnaker_ 5y ago
    "Doorway in the style of Escher"
  • dqpb 5y ago
    It looks to me like the faucet sprays water sideways toward the bowl, which is genius, because then you aren’t bumping up against it when you’re washing your hands!
• imperio59 5y ago
  What happens when they train this thing to make videos? We're about to be dealing with a flood of AI-generated visual/video content. We already have to deal with text bots everywhere... wow.
  • eks391 5y ago
    I'm excited for when that happens. I didn't think of the malicious uses, which now that you brought it up I can think of many, but I still think the pros are worth the cons
• Imnimo 5y ago
  I'm only part way through the paper, but what struck me as interesting so far is this: In other text-to-image algorithms I'm familiar with (the ones you'll typically see passed around as colab notebooks that people post outputs from on Twitter), the basic idea is to encode the text, and then try to make an image that maximally matches that text encoding. But this maximization often leads to artifacts - if you ask for an image of a sunset, you'll often get multiple suns, because that's even more sunset-like. There's a lot of tricks and hacks to regularize the process so that it's not so aggressive, but it's always an uphill battle. Here, they instead take the text embedding, use a trained model (what they call the 'prior') to predict the corresponding image embedding - this removes the dangerous maximization. Then, another trained model (the 'decoder') produces images from the predicted embedding. This feels like a much more sensible approach, but one that is only really possible with access to the giant CLIP dataset and computational resources that OpenAI has.
  • recuter 5y ago
    What always bother me with this stuff is, well, you say one approach is more sensible than the other because the images happen to come out more pleasing. But there's no real rhyme or reason, it is a sort of alchemy. Is text encoding strictly worse or is it an artifact of the implementation? And if it is strictly worse, which is probably the case, why specifically? What is actually going on here? I can't argue that their results are not visually pleasing. But I'm not sure what one can really infer from all of this once the excitement washes over you. Blending photos together in a scene in photoshop is not a difficult task. It is nuanced and tedious but not hard, any pixel slinger will tell you. An app that accepts a smattering of photos and stitches them together nicely can be coded up any number of ways. This is a fantastic and time saving photoshop plugin. But what do we have really? "Kuala dunking basketball" needs to "understand" the separate items and select from the image library hoops and a Kuala where the angles and shadows roughly match. Very interesting, potentially useful. But if doesn't spit up exactly what you want can't edit it further. I think the next step has got to be that it conjures up a 3d scene in Unreal or blender so you can zoom in and around convincingly for further tweaks. Not a flat image.
    • 4y ago
• croddin 5y ago
  This reminds me of the holodeck in Star Trek. Someone could walk into the Holodeck and say “make a table in the center of the room. Make it look old.” It seemed amazing to me that the computer could make anything and customize it with voice. We are pretty close to star trek technology now in computer ability (ship’s computer, not Commander Data). I guess to really be like the holodeck it needs to be able to do 3d and be in real time but that seems a lot closer now. It will be cool when this could be in VR and we can say make an astronaut riding a horse, then we can jump on the back of the horse and ride to a secret moon base.
  • deleted 5y ago
    [deleted]
• qualudeheart 5y ago
  Deep Learning plows through yet another wall.
• billconan 5y ago
  I'm curious, is this something feasible to train (and inference) on a consumer level machine, or this is something can only be done by institutes?
• narrator 5y ago
  While we're being distracted by endless social media and meaningless news, AI technology is advancing at a mind blowing pace. I'd keep my eye on that ball instead of "the current thing."
  • The_rationalist 5y ago
    Thank you narrative voice
• aChrisSmith 5y ago
  I can see how this has the potential to disrupt the games industry. If you work on a AAA title, there is a small army of artists making 19 different types of leather armor. Or 87 images of car hubcaps. Using something like this could really help automate or at least kickstart the more mundane parts of content creation. (At least when you are using high resolution, true color imagery.)
  • killerstorm 5y ago
    This thing can't do 3D models. There are some 3D image generation techniques, but they aren't based on polygonal modelings, so 3D artists are safe for now
    • refulgentis 4y ago
      Colab notebooks can do mesh models using this method, I'm certain OpenAI isn't far away
    • pwillia7 4y ago
      You could train a model on texture image data though, no? Or what about even generating images you could then photogrammetry into models?
      • drusepth 4y ago
        Yeah, there's a lot of 2D assets that this model would be great for (textures, materials, *maps, etc) that would definitely improve the asset-building process for game devs. I've already used VQGAN+CLIP for some low-res skill and item icons in hobby games and it seems things are only improving from here. I wouldn't be surprised to see a comparable version for 3D models in the next year or two, though. Even if the current architecture doesn't lend itself to 3D structures (I don't know), there's a lot of parallel work being done right now (esp. by Google) for encoding 3D data in new/efficient ways, translating specialized 2D images into 3D models, and more.
• minimaxir 5y ago
  A few comments by someone who's spent way too much time in the AI-generated space: * I recommend reading the Risks and Limitations section that came with it because it's very through: https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-c... * Unlike GPT-3, my read of this announcement is that OpenAI does not intend to commercialize it, and that access to the waitlist is indeed more for testing its limits (and as noted, commercializing it would make it much more likely lead to interesting legal precedent). Per the docs, access is very explicitly limited: (https://github.com/openai/dalle-2-preview/blob/main/system-card.md#access https://github.com/openai/dalle-2-preview/blob/main/system-c... ) * A few months ago, OpenAI released GLIDE ( https://github.com/openai/glide-text2im https://github.com/openai/glide-text2im ) which uses a similar approach to AI image generation, but suspiciously never received a fun blog post like this one. The reason for that in retrospect may be "because we made it obsolete." * The images in the announcement are still cherry-picked, which is therefore a good reason why they tested DALL-E 1 vs. DALL-E 2 presumably on non-cherrypicked images. * Cherry-picking is relevant because AI image generation is still slow unless you do real shenanigans that likely compromise image quality, although OpenAI has likely a better infra to handle large models as they have demonstrated with GPT-3. * It appears DALL-E 2 has a fun endpoint that links back to the site for examples with attribution: https://labs.openai.com/s/Zq9SB6vyUid9FGcoJ8slucTu https://labs.openai.com/s/Zq9SB6vyUid9FGcoJ8slucTu
  • YeGoblynQueenne 4y ago
    Regarding cherry-picking, the images of astronauts on horses look stunning, except for their hands. There's something seriously wrong with their hands. Maybe give it another five years, a few more $billion and a few more petabytes/flops and it will be good. Then finally everyone can generate art for their own Magic: the Gathering cards. (That's the end goal, right?)
    • a_bonobo 4y ago
      Interestingly, hands are also something humans struggle to draw. They're a very complex anatomical form, many small tendons and muscles. Many artists struggle to depict hands. They're not made out of a few straight lines like a torso, there's lots of skew going on. They're probably the hardest structure of the human body to 'learn' for a ML system.
• mario143 5y ago
  Yeah, I mean you're right that ultimately the proof is in the pudding. But I do think we could have guessed that this sort of approach would be better (at least at a high level - I'm not claiming I could have predicted all the technical details!). The previous approaches were sort of the best that people could do without access to the training data and resources - you had a pretrained CLIP encoder that could tell you how well a text caption and an image matched, and you had a pretrained image generator (GAN, diffusion model, whatever), and it was just a matter of trying to force the generator to output something that CLIP thought looked like the caption. You'd basically do gradient ascent to make the image look more and more and more like the text prompt (all the while trying to balance the need to still look like a realistic image). Just from an algorithm aesthetics perspective, it was very much a duct tape and chicken wire approach. The analogy I would give is if you gave a three-year-old some paints, and they made an image and showed it to you, and you had to say, "this looks like a little like a sunset" or "this looks a lot like a sunset". They would keep going back and adjusting their painting, and you'd keep giving feedback, and eventually you'd get something that looks like a sunset. But it'd be better, if you could manage it, to just teach the three-year-old how to paint, rather than have this brute force process. Obviously the real challenge here is "well how do you teach a three-year-old how to paint?" - and I think you're right that that question still has a lot of alchemy to it.
• turdnagel 5y ago
  I'm genuinely curious to hear Sam Altman's (and/or the OpenAI team's) perspective on why these products need to be waitlisted. If it's a compute issue, why not build a queuing system? If it's something else (safety related? hype related?) I'd love to understand the thinking behind the decision. More often than not, I sign up for waitlists for things like this and either (1) never get in to the beta or (2) forget about it when I eventually do get in.
  • minimaxir 5y ago
    For GPT-3 it was a combination of both compute and safety. Given the notes in the System Card (https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-c... ), OpenAI is likely doubling-down on safety here.
• Ftuuky 5y ago
  What jobs will be there in 5~10 years when we consider all the progress done with Dall-E, GPT-3, Codex/GitHub Copilot, Alpha* and so on?
  • beders 5y ago
    The ones undoing the damage caused by dumb pattern recognizers and generators? ;)
  • 6gvONxR4sf7o 5y ago
    Things that require understanding of causation will be safe longer. Progress like this is driven by massive datasets. Meanwhile, real world action-taking applications require different paradigms to take causation into account[0][1], and especially to learn safely (e.g. learning to drive without crashing during the beginner stages). There's certainly research happening around this, and RL in games is a great test bed, but people choosing actions will safe from automation longer than people not choosing actions, if that makes sense. It's the person who decides "hire this person" vs the person who decides "I'll use this particular shade of gray." [0] The best example is when X causes Y and X also causes Z, but your data only includes Y and Z. Without actually manipulating Y, you can't see that Y doesn't cause Z, even if it's a strong predictor. [1] Another example is the datasets. You need two different labels depending on what happens if you take action A or B, which you can't have simultaneously outside of simulations.
  • phphphphp 5y ago
    Most creative output is duplicated effort: consider how much code each person on HN has written that has been written before. Consider how, a decade ago, we were all writing html and styling it, element by element, and then Twitter bootstrap came along and revolutionised front-end development in what is, ultimately, a very small and low technology way. All it really did was reduce duplicate effort. Nowadays there’s lots of great low/no code platforms, like Retool, that represent a far greater threat to the amount of code that needs to be produced than AI ever will. To use a cliche: code is a bug, not a feature. Abstracting away the need for code is the future, not having a machine churn out the same code we need today.
• jedberg 5y ago
  This reminds me of a discussion I had with the high school band teacher in the 90s. I was telling him that one day computers would play music and you won't be able to tell the difference. He got mad at me and told me that a computer could never play as well as a human with feelings, who can feel the piece and interpret it. I think we passed that point a while ago, but seeing this makes me think we aren't too far off from computers composing pieces that actually sound good too.
• zackmorris 5y ago
  Apologies for an open-ended question but: does anyone know if there is a term for something like Turing-completeness within AI, where a certain level of intelligence can simulate any other type of intelligence like our brains do? For example, using DeMorgan's theorem, we can build any logic circuit out of all NAND or NOR gates: https://www.electronics-tutorials.ws/boolean/demorgan.html https://www.electronics-tutorials.ws/boolean/demorgan.html https://en.wikipedia.org/wiki/NAND_logic https://en.wikipedia.org/wiki/NAND_logic https://en.wikipedia.org/wiki/NOR_logic https://en.wikipedia.org/wiki/NOR_logic Dall-E 2's level of associative comprehension is so far beyond the old psychology bots in the console pretending to be people, that I can't help but wonder if it's reached a level where it can make any association. For example, I went to an AI talk about 5 years ago where the guy said that any of a dozen algorithms like K-Nearest Neighbor, K-Means Clustering, Simulated Annealing, Neural Nets, Genetic Algorithms, etc can all be adapted to any use case. They just have different strengths and weaknesses. At that time, all that really mattered was how the data was prepared. I guess fundamentally my question is, when will AGI start to become prevalent, rather than these special-purpose tools like GPT-3 and Dall-E 2? Personally I give it less than 10 years of actual work, maybe less. I just mean that to me, Dall-E 2 is already orders of magnitude more complex than what's required to run a basic automaton to free humans from labor. So how can we adapt these AI experiments to get real work done?
  • astrange 4y ago
    > Apologies for an open-ended question but: does anyone know if there is a term for something like Turing-completeness within AI, where a certain level of intelligence can simulate any other type of intelligence like our brains do? > So how can we adapt these AI experiments to get real work done? You're missing a step here - the difference between "imagining doing something" and "actually doing something". An ML model can produce thoughts, but that isn't necessarily the same direction of research as actually doing things in real life, much less becoming superhuman and taking over the world etc. In your imagination, everything always goes your way.
  • teaearlgraycold 5y ago
    > does anyone know if there is a term for something like Turing-completeness within AI, where a certain level of intelligence can simulate any other type of intelligence like our brains do? Artificial General Intelligence
• jelliclesfarm 5y ago
  “Preventing Harmful Generations”? = Fail. Caravaggio is probably chortling from wherever he is ..
• zitterbewegung 5y ago
  I don’t want to dismiss this new model and achievements but we are getting to the point where I feel like what we saw in the open source versus close source systems we see in new ml models another one is forming for open and closed models. I think that larger and larger models will have disclaimers either restricting you from using it commercially (a great deal of academics and NVIDIA models are doing this. And OpenAI just puts it behind an API with the rules : Curbing Misuse Our content policy does not allow users to generate violent, adult, or political content, among other categories. We won’t generate images if our filters identify text prompts and image uploads that may violate our policies. We also have automated and human monitoring systems to guard against misuse.
  • asxd 5y ago
    They're pretty strict about usage: - https://github.com/openai/dalle-2-preview/blob/main/system-card.md https://github.com/openai/dalle-2-preview/blob/main/system-c... - https://github.com/openai/dalle-2-preview/blob/main/system-card.md#access https://github.com/openai/dalle-2-preview/blob/main/system-c...
  • jdrc 5y ago
    It should be possible to create open source versions, researchers will find a way if something is cool enough
• aaron695 5y ago
• 6gvONxR4sf7o 5y ago
  This is a niche complaint, but I get frustrated at how imprecise open AI's papers are. When they describe the model architecture, it's never precise enough to reproduce exactly what they did. I mean, it pretty much never is in ML papers[0], but open AI's bigger products are worse than average with it. And it makes sense, since they're trying to be concise and still spend time on all the other important stuff besides methods, but it still frustrates me quite a bit. [0] Which is why releasing your code is so beneficial.
  • gwern 4y ago
    They've added some more details to the paper.
• marviel 5y ago
  It's becoming clear that efficient work in the future will hinge upon one's ability to accurately describe what one wants. Unpacking that -- a large piece is the ability to understand all the possible "pitfalls" and "misunderstandings" that could happen on the way to a shared understanding. While technical work will always have a place -- I think that much creative work will become more like the management of a team of highly-skilled, niche workers -- with all the frustrations, joys, and surprises that entails.
  • golergka 5y ago
    > accurately describe what one wants Isn't that essentially what programming already is?
  • armchairhacker 5y ago
    Programming, art, music, is just “describing what you want” in a very specific way. This is describing what you want in a much more vague way. The upside it that it’s more “intuitive” and requires much less detail and technique, as the AI infers the detail and technique. The downside is that it’s really hard to know what the AI will generate or get it to generate something really specific. I believe the future will combine the heuristics of AI-generation with the specificity of traditional techniques. For example, artists may start with a rough outline of whatever they want to draw as a blob of colors (like in some AI image-generation papers). Then they can fill in details using AI prompts, but targeting localized regions/changes and adding constraints, shifting the image until it’s almost exactly what they imagined in their head.
  • deleted 5y ago
    [deleted]
  • killerstorm 5y ago
    No... These models are trained to predict. You can definitely make them incremental. You can give it a task like "make a more accurate description from initial description and clarification". Even GPT-3-based models available today can do these tasks. Once this is properly productionized it would be possible to implement stuff just talking with a computer.
• whywhywhywhy 5y ago
  I never actually found a way to use Dall-E 1, did they ever Open that up to people outside their building?
• deleted 5y ago
  [deleted]
• deleted 5y ago
  [deleted]
• arecurrence 5y ago
  Is there a geometric model relative to this? EG: "corgi near the fireplace" but the output is a 3d model of the corgi and fireplace with shaders rather than an image.
  • majidmir 4y ago
    Wait until you see the same concept combined with NeRF idea. The output won’t be 3d shapes but another model that can generate realistic and geometrically consistent images of a scene viewed from different angles.
• ordu 5y ago
  Dall-E 2 seems to be incapable to catch the essence of the art. I'm not really surprised by it, I'd be surprised a lot if it could. But nevertheless: if you looked in the eye of a Girl With A Pearl Earring[1], you'd be forced to stop and to think what does she have on her mind right now. Or may be you had some other question in your mind, but it really stops people to think. But none of Dall-E interpretations have this quality. Works inspired by Girl With A Pearl Earring sometimes have at least part of that power, like Girl With a Babmoo Earring[2]. But none of Dall-E interpretations have such a power. And this observation may lead to a great consequences for visual arts. I had a lot of joy of looking at different Dall-E interpretations to find what the flaw of the interpretation that forbids it to be a piece of art of an equal value to the original. It is a ready made tool to search for explanations of the Power of Art. It cannot say what detail make a picture to be an artwork, but it allow to see multiple data points, and to narrow the hypothesis space. My main conclusion is that the pearl earring have nothing to do with the power of art. It is something in the eye, and probably with the slightly opened mouth. (Somehow Dall-E pictured all interpretations with closed lips, so it seems to be an important thing, but I need more variation along this axis to be sure). [1] https://en.wikipedia.org/wiki/Girl_with_a_Pearl_Earring https://en.wikipedia.org/wiki/Girl_with_a_Pearl_Earring [2] https://yourartshop-noldenh.com/awol-erizku-girl-with-the-pearl-earring https://yourartshop-noldenh.com/awol-erizku-girl-with-the-pe...
  • deleted 5y ago
    [deleted]
  • joshcryer 5y ago
    What do you think of the third to last image of the Girl With A Pearl Earring that DALL-E 2 created? I find it more compelling than the original with how her face is deeply cast in shadow. There's still that original 'essence' of the glint in her eye. But her earring is a bell. As if the AI is sending a message that what if the bell were to ring?
    • ordu 5y ago
      I'm not sure, that I can express myself in English, which is not my native language, and this needs some very nuanced control over tiniest shades of meaning, but I'll try nevertheless, just for fun of it at least. The original girl is more open, more independent and mindless. The interpretation's girl is more self-controlled, assertive and not interested really, just going throw all those movements of regular communication between people. Maybe it's just me, but what I really value on such occasions is mindlessness, the ability of people to not mind themselves, to let their selves to dissolve in the environment. I cannot keep tears in my eyes sometimes when I watch some entertainer playing Chopin or Paganini, because what I see in their movements is complete dissolution of a person in a piece of music, in a piece of art and skill. An entertainer just do what they do with their full attention on it, and with all their motivation focused on it. There is nothing here for them, just them and their actions. There is not a single thought devoted to how people around me would react to what I do and how I do that. I just do what I do and I do not care about people around me, and if it somehow makes people happy... I don't care really. I mean I know that afterwards I'd feel a pride of myself, but just for now I don't really care. I know this feeling. I like to sing, and I'm good at it (above average), and I know what it feels like to dissolve into the song and to let song to rule. I play piano and I know what it is like to dissolve into the piece I'm playing, to stop myself from existing, to let music to take the lead. And the original painting make me believe that the girl is in this state of mind. I do not know the history or the remaining of the story, I do not know if she get into this state for a second, of she never leaves it (it may be a sad experience, don't you think?), but somehow I know that right now she is right in this state. I want to watch this her moment for an eternity. Thinking about it, I'd confess that Interpretation Girl does trigger the same, but on a smaller scale. I feel how my mind is trying to find a coherent state to her gaze, but this feeling stops in tens of microseconds, not hundreds of them. edit: want->watch. Stupid mistake ruining the meaning of the sentence.
• thisistheend123 5y ago
  This is what magic looks like. Great work. Looking forward to when they start creating movies from scripts.
• nope96 5y ago
  Is there an 'explain it like I'm 15' for how this works? It seems like black magic. I've been a computer hobbyist since the late 1980's and this is the first time I cannot explain how a computer does what it does. Absolutely the most amazing thing I've ever seen, and I have zero clue how it works.
  • karmasimida 5y ago
    Diffusion models are indeed pretty magical.
  • joshcryer 5y ago
    I'm with you there but we still don't know how it works, just that it does. The method though is you take a bunch of images, you plug them into a multi dimensional array (a nice way of saying a tensor), have some kind of tagging system, and when you ask the system for an answer, it will put one out for you. So for example in the astronaut riding the horse, there is, on some level, a picture of a horse with those similar pixels, that exists in the data of some object tagged 'horse.' Likewise with astronaut. What is important is that the data sets are absolutely massive, with billions of parameters. Here's a more of a 'not 15 year old' explanation: https://ml.berkeley.edu/blog/posts/dalle2/ https://ml.berkeley.edu/blog/posts/dalle2/
    • sanxiyn 4y ago
      Note that linked post is an explanation of DALL-E, not DALL-E 2, which works differently.
  • drcode 5y ago
    Imagine asking it to generate a picture for "duck wearing a hat on Mars": First, it creates a random 10x10 pixel blurry image and asks a neural net: "Could this be a duck wearing a hat on Mars?" and the neural net replies "No, because all the pictures I've ever seen of Mars have lots of red color in them" so the system tweaks the pixels to make them more red, put some pixels in the center that have a plausible duck color, etc. After it has a 10x10 image that is a plausible duck on Mars, the system scales the image to 20x20 pixels, and then uses 4 different neural nets on each corner to ask "Does this look like the upper/lower left/right corner of a duck wearing a hat on Mars?" Each neural net is just specialized for one corner of the image. You keep repeating this with more neural nets until you have a pretty 1000x1000 (or whatever) image.
• cm2012 5y ago
  Sam's Twitter thread today was more impressive than the website. https://twitter.com/sama/status/1511724264629678084?s=20&t=61dOmep48ww0SHMRVQ4_Mg https://twitter.com/sama/status/1511724264629678084?s=20&t=6...
• awinter-py 5y ago
  They're using training set restriction and prompt engineering to control its output > By removing the most explicit content from the training data, we minimized DALL·E 2’s exposure to these concepts > We won’t generate images if our filters identify text prompts and image uploads that may violate our policies The 'how to prevent superintelligences from eating us' crowd should be taking note: this may be how we regulate creatures larger than ourselves in the future And even how we regulate the ethics of non-conscious group minds like big companies
• falcor84 5y ago
  >We’ve limited the ability for DALL·E 2 to generate ... adult images. I think that using something like this for porn could potentially offer the biggest benefit to society. So much has been said about how this industry exploits young and vulnerable models. Cheap autogenerated images (and in the future videos) would pretty much remove the demand for human models and eliminate the related suffering, no? EDIT: typo
  • uoaei 4y ago
    No. If people are exposed to stimuli, they will pursue increasingly stimulating versions of it. I.e., if they see artificial CP, they will often begin to become desensitized (habituated) and pursue real CP or even live children thereafter. Conversely, if people are not exposed to certain stimuli, they will never be able to conceptualize them, and thus will be unable to think about them. Obviously you cannot eliminate all CP but minimizing the overall levels of exposure / ease of access to these kinds of things is way more appropriate than maximizing it.
    • sneak 4y ago
      > If people are exposed to stimuli, they will pursue increasingly stimulating versions of it. I.e., if they see artificial CP, they will often begin to become desensitized (habituated) and pursue real CP or even live children thereafter. I have accumulated tens of thousands of headshots in video games but have yet to ever shoot a single real person in the face. More importantly, I have never had the urge to seek out same. I am not sure that your initial premise has any truth to it.
      • uoaei 4y ago
        The point is more "can you conceive of a headshot before you've ever witnessed one?" And the assertion is, no. I should be explicit -- I am saying the exposure which makes one seek stimulus is merely a catalyst for deeper urges, not a generator of them as such. A certain level of inhibition (e.g. sociopathy) is required but IMO so is a prior conception of the deed. In your example, if someone is predisposed to wanting to shoot actual people in the head, exposing them to video game headshots may distract in the short term but desensitizes and entrenches the image in the long term, possibly making it easier to decide to pull the trigger later on if they are sufficiently inhibited of social concerns. This does not happen for people with high inhibitions, or at least sufficient self-control.
• Dig1t 5y ago
  Most of the conversation around this model seems to be about its direct uses. This seems to me like a big step towards AGI; a key component of consciousness seems (in my opinion) to be the ability to take words and create a mental picture of what's being described. Is that the long term goal WRT researching a model like this?
• skybrian 5y ago
  Sam Altman took some user requests on Twitter: https://twitter.com/sama/status/1511724264629678084 https://twitter.com/sama/status/1511724264629678084
• Traster 5y ago
  To be honest the Girl with a Pearl Earing "variations" look a little bit like a crime against art. It's like the person who built this has no idea why the Girl with a Pearl Earing is good art. "Here's the Girl with a Pearl Earing " - "OK, well here's some girls with turbans" Art is truth.
  • whateveracct 4y ago
    Yeah Dall-E makes stuff that qualifies as art to the eye of a philistine. Makes sense it was built with VC money.
  • bbbobbb 5y ago
    To be honest it's hard for me to imagine alternate reality where the 'original' is not swapped with one of the 'variations' without same comment underneath. Why is the 'original' good art?
  • sillysaurusx 5y ago
    Maybe. https://cdn.openai.com/dall-e-2/demos/variations/modified/girl_with_pearl_earring/2.jpg https://cdn.openai.com/dall-e-2/demos/variations/modified/gi... was pretty impressive. I think the results are being poisoned by the fact that most old paintings have deteriorated colors, so the training data looks nothing like the originals. It's certainly a lot yellower than https://cdn.openai.com/dall-e-2/demos/variations/originals/girl_with_pearl_earring.jpg https://cdn.openai.com/dall-e-2/demos/variations/originals/g...
  • eks391 5y ago
    > It's like the person who built this has no idea why the Girl with a Pearl Earing is good art. The people didn't program Dall E how to make art. They taught it to recognize patterns and create something by extrapolating from the patterns, all on its own. So the AI isn't a projection of what they think is good art, it's projecting what it thinks is good art, based on a prompt. The output is its best effort of a feeling, even if the feeling had to be inputted by a living person. So it's still art that's as good as the feeling that it came from-fleeting feelings being lower quality than those that required more time and thought
• EZ-Cheeze 5y ago
  "Computer, render Bella and Gigi Hadid playing tennis in bikinis"
• greyhair 5y ago
  Interesting, yes, but I went to the link, and browsed the 'generated artwork' and all if it was subjectively inferior to the original that it generated from. Every single piece. So I am not sure what the 'value' in it is, at this stage. As far as the text driven, I would have to mess with some non pre-canned presentations to see how useful it was.
• rndphs 5y ago
  This is going to be mostly a rant on OpenAI's "safer than thou" approach to safety, but let me start with that I think this technology I think is really cool, amazing, powerful stuff. Dall-E (and Dall-E 2) is an incredible advance over GANs, and no doubt will have many positive applications. It's simply brilliant. I am someone who has been interested in and has followed the progress of ML generated images for nearly a decade. Almost unimaginable progress has been made in the last five years in this field. Now the rant: I think if OpenAI genuinely cared about the ethical consequences of the technology, they would realise that any algorithm they release will be replicated in implementation by other people within some short period of time (a year or two). At that point, the cat is out of the bag and there is nothing they can do to prevent abuse. So really all they are doing is delaying abuse, and in no way stopping it. I think their strong "safety" stance has three functions: 1. Legal protection 2. PR 3. Keeping their researchers' consciences clear I think number 3 is dangerous because researchers are put under the false belief that their technology can or will be made safe. This way they can continue to harness bright minds that no doubt have ethical leanings to create things that they otherwise wouldn't have. I think OpenAI are trying to have the cake and eat it too. They are accelerating the development of potentially very destructive algorithms (and profiting from it in the process!), while trying to absolve themselves of the responsibility. Putting bandaids on a tumour is not going to matter in the long run. I'm not necessarily saying that these algorithms will be widely destructive, but they certainly have the potential to be. The safety approach of OpenAI ultimately boils down to gatekeeping compute power. This is just gatekeeping via capital. Anyone with sufficient money can replicate their models easily and bypass every single one of their safety constraints. Basically they are only preventing poor bad actors, and only for a limited time at that. These models cannot be made safe as long as they are replicable. To produce scientific research requires making your results replicable. Therefore, there is no ability to develop abusable technology in a safe way. As a researcher, you will have blood on your hands if things go wrong. If you choose to continue research knowing this, that is your decision. But don't pretend that you can make the algorithms safer by sanitizing models.
  • visarga 4y ago
    OpenAI is not the only AI shop. If they didn't make DALL-E someone else would, and control its release as they see fit.
• duren 5y ago
  I've been playing around with it today and have been super impressed with its ability to generate pretty artful digital paintings. Could have big implications for designers and artists if and when they allow you use custom palettes, etc. Here's an example from my prompt ("a group of farmers picking lettuce in a field digital painting"): https://labs.openai.com/s/jb5pzIdTjS3AkMvmAlx69t7G https://labs.openai.com/s/jb5pzIdTjS3AkMvmAlx69t7G
  • Sateeshm 4y ago
    Honestly, that painting is nonsensical. It's great at a glance. But when you look at it for a few seconds, it's just impressionist type blob painting without any features that make impressionist paintings great.
  • pingeroo 4y ago
    Neat! Were you part of the initial testing batch or granted access via waitlist?
    • duren 4y ago
      I was invited
• lalopalota 5y ago
  One step closer to combining Scribblenuats with emoticons!
• uses 5y ago
  Is anyone looking into what it means when we can generate infinite amounts of human-like work without effort or cost? > Curbing Misuse [...] That's great, nowadays the big AI is controlled by mostly benevolent entities. How about when someone real nasty gets a hold of it? In a decade the models anyone can download will make today's GPT-3 etc look like pong right? Recommender systems etc are already shaping society and culture with all kinds of unintended effects. What happens when mindless optimizing models start generating the content itself?
• _nateraw 5y ago
  If you're interested in generative models, Hugging Face is putting on an event around generative models right now called the HugGAN sprint, where they're giving away free access to compute to train models like this. You can join it by following the steps in the guide here: https://github.com/huggingface/community-events/tree/main/huggan https://github.com/huggingface/community-events/tree/main/hu... There will also be talks from awesome folks at EleutherAI, Google, and Deepmind
• bradgessler 5y ago
  Could somebody build this for SVG icons? I’d invest in it.
  • applgo443 5y ago
    What do you want?
    • bradgessler 4y ago
      A library like https://icons8.com/icons https://icons8.com/icons where you can just tell it what icon you want and the style (e.g. Material, outline, solid, iOS). It would do it’s thing and spit it out.
• sydthrowaway 5y ago
  gamechanger
• dang 5y ago
  Related and kind of fun: Sam Altman demonstrates Dall-E 2 using twitter suggestions - https://news.ycombinator.com/item?id=30933478 https://news.ycombinator.com/item?id=30933478 - April 2022 (3 comments)
• kovek 5y ago
  One of my teachers once said “An art piece is never done”. So, I wonder what could that mean for the model to keep making improvements to the piece.
  • chronolitus 5y ago
    IIRC that's how it works! it starts from a first image, and improves it until 'satisfied' that the result fits the prompt
• albertzeyer 5y ago
  Some initial video by Yannic Kilcher: https://www.youtube.com/watch?v=gGPv_SYVDC8 https://www.youtube.com/watch?v=gGPv_SYVDC8
• victor_e 5y ago
  Wow - mindblowing and kinda scary really.
• krick 5y ago
  Regardless of how much cherry-picking there was, some of these pictures are just beautiful.
• Apofis 4y ago
  So I can't do Teddy Bears Riding a Horse?
• mycroftiv 4y ago
  My main question is - is this really 'open' meaningfully? And are concepts of kindness and freedom being applied to the minds inside the boxes? I dont know where the 'openai' brand is at on these things personally.