36 ms·

Imagen: An AI system that creates photorealistic images from input text

293 points by fagnerbrack 4y ago

sebringj 4y ago
This will be nice when a person wants a custom item tailor made to describe visually what it should look like and verify the picture before sending over. Taking that idea further into the future, we can clearly see how speech-to-text and dynamic adjustments coupled with 3d printing could lead.
anshul 4y ago
Does anyone know if or when google intends to make this available for beta testing or public use?
- carrozo 4y ago
  Towards the bottom of the page they say: “The potential risks of misuse raise concerns regarding responsible open-sourcing of code and demos. At this time we have decided not to release code or a public demo. In future work we will explore a framework for responsible externalization that balances the value of external auditing with the risks of unrestricted open-access.”
  - Traubenfuchs 4y ago
    Are they afraid of lawsuits or are they painfully regressive, prude moralists? Stable diffusion was un-neutered within 24 hours of its public release and the worst people do with it is Emma Watson porn.
    - shmageggy 4y ago
      It's not about prudishness, although generating pornography is one of the concerns. In the paper there's a full page on ethical concerns, but some of issues they mention are misinformation, and perpetuating harmful cultural stereotypes around race and/or gender roles.
    - mook 4y ago
      Or they just remember Microsoft Tay: https://en.wikipedia.org/wiki/Tay_(bot) https://en.wikipedia.org/wiki/Tay_(bot)
    - zo1 4y ago
      In a nutshell they're afraid of people using prompts generating black people looking like monkeys/gorillas. And other such sensitive examples that others have posted/mentioned.
  - quitit 4y ago
    While I understand that view, pandora’s box is already open, by their own measurements other publicly-available technology is comparable: so the only thing they’re stopping with this is direct comparison of their tech to others. A more cynical side of me just thinks Google is rushing out the PR (including the hand-plucked sample images) because they can see that the state of the tech is progressing rapidly and perhaps by the time their tech is release-ready a competitor will already have something better (the new round of betas certainly look promising.) It is a little bit on brand for Google to make an announcement they have the best, only for those claims to fall over later.
  - aantix 4y ago
    By the time they figure out the "responsible externalization" portion, competitors (including open source) will surpass their results. The technology isn't special to Google. They don't control its proliferation.
- indy 4y ago
  They're probably afraid that people will generate images that don't conform to the current American Progressive Vision.
polotics 4y ago
Not a single human face in these samples. I wonder how well it does on faces.
- tmikaeld 4y ago
  I’m also curious. The animal faces and eyes look good, less creepy than most.
- 8n4vidtmkvmk 4y ago
  have you seen https://thispersondoesnotexist.com/ https://thispersondoesnotexist.com/ ? that's old already. different tech tho
- andresgottlieb 4y ago
  Saul Goodman if he was a character in Twin Peaks: https://media.discordapp.net/attachments/999426920376717513/1011642719208214528/agottlieb_Saul_Goodman_as_a_character_in_Twin_Peaks_HDR_4K_f931186a-233e-4a70-86c8-76a78098d43f.png https://media.discordapp.net/attachments/999426920376717513/... Generated with Midjourney Beta
  - glenneroo 4y ago
    Which is now Stable Diffusion under the hood, sprinkled with a little prompt parsing "magic".
    - Terretta 4y ago
      This may be misleading. As far as I could tell (using it before, during, and after this Beta option was available) it was the upscalar using that, not the original 4 image generation.
- ansible 4y ago
  The samples I was shown definitely had a theme: robots, raccoons, hats, and raccoons wearing hats. Our brains are very thoroughly wired to detect faces in general, and flaws in faces. So we have a very, very high standard for what passes muster. We are apparently much more forgiving with regards to what raccoons and corgis look like.
bottlepalm 4y ago
Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder what’s next.
- culi 4y ago
  People are getting into "prompt-craft". People have also started pasting different AI tools together like putting these images into CogVideo[0] to generate actual videos (takes ages and usually the length of a gif currently). Others have realized you can run these images through GANs to make faces look extremely convincing I think "what's next" is fitting these tools together in a larger system [0] https://replicate.com/nightmareai/cogvideo https://replicate.com/nightmareai/cogvideo
  - bottlepalm 4y ago
    Ok I’m just going to list ideas, feel free to add more * Text to 3d model * Text to video clip * Illustrations for newspapers * Generating pictures for food menus * Generating a music video from a song * Generating pictures or even an entire movie for a book * Interior design ideas * Product design ideas I have noticed that leveraging these tools isn’t easy. It requires a fair bit of creativity to come up with the prompts to create an image to really wow somebody.
    - culi 4y ago
      Someone on the midjourney discord is making a comic with images generated by the bot. Another person is making a Magic The Gathering card pack with generated art (it looks good too!). People are already using it for stock photos One murky area we're still far away from but I'm curious to follow the developments on: AI-generated movies. Once generated clips gets good, what if some movie buff can just generate a movie, scene-by-scene, just using these tools? What about "casting" certain celebrities? The comic I mentioned uses Zendaya (probably because she plays a character in the Dune movies) as a character
      - 4y ago
NationOfJoe 4y ago
i only have a passing curiosity in these projects personally. can someone in the field explain why this has exploded recently? there seems to be a lot of these tools released recently (text to image) was there a major breakthrough? a new idea that pushed everyone forward? a recent sharing of talent between groups? edit: just another thought, are they just being posted to HN now, i don't see a date on the page for when it was released . I also don't know the general term to find a list of all of these to find all the release dates
- Rebelgecko 4y ago
  Not in the field, but maybe diffusion models? They seem to be used by a lot of different image generation techniques.
- derac 4y ago
  The first major projects were OpenAI's DALL-E, then DALL-E 2 a year later. DALL-E 2 was much much better. After that a few new projects have been released in rapid succession including the open source stable diffusion. Here are some of the projects on GitHub: https://github.com/topics/text-to-image https://github.com/topics/text-to-image Another good source is https://paperswithcode.com/task/text-to-image-generation https://paperswithcode.com/task/text-to-image-generation
- rapnie 4y ago
  I don't know. This 'explosion' in the public space may just be the technology crossing a threshold where big $$$ are on the table and competitors rushing in to get hold of good chunks of the emerging market. No tech breakthrough, but a marketing & sales assault.
- deleted 4y ago
  [deleted]
- MathYouF 4y ago
  Like anyone deeply in a field I know maybe several thousand people who could probably give a better answer, but I figure I'll give an effort to provide one since I don't see any good ones posted yet. The moment everyone knew this was going to be big was in 2019 when StyleGAN came out. They used a lot of tricks like aligning face features (like eyes) and had all their pictures of a single domain (the most famous being faces) but none the less, that was the moment everyone in the AI field knew this was going to be big, and so three years ago a lot of big people shifted to this line of research. The four main innovations since then have been: 1. Transformers Generalized computation kernels which allow for images to consider non-localised relationships between pixels of an image. Released in 2017, and originally used for language. 2. Pixel Patch Encodings Different resolution semantic and geometric image information encodings which allow for better representations of relationships between image areas than pixels are able to achieve given the same compute. Allows using Transformers on high resolution images. 3. CLIP Contrastive Language and Image Pairing. Before, the only way we knew to classify an image was as a "face" or "cat" or "ramen". When the genius idea of labeling images as semantically meaningful vectors rather than one hot encoded classes was revealed, it changed everything in computer vision very quickly, and problems that used to be hard became trivial. Released in 2021 4. Diffusion Models GANs penalise you for making an image which does not seem to be part of an existing dataset. This encourages one to make the worst quality image that looks like a member of that dataset. Diffusion learns to denoise an image, removing noise is perceptually similar to increasing resolution, people like images that look that way. There may be more people with better intuition about diffusion models may be able to add on why they're superior. I've read all the papers leading up to the latest unCLIP (Dalle2) but it's complicated. Released in 2020, with major improvements to the training process continuously being made since then. Hope this was helpful. All of the above were only implemented for images in any real way in the last three years. Putting them all together is something many people only just this year did, resulting in DallE, Stable Diffusion, and Imagen. I'm working on doing this for 3D and later for use cases in AR. 3D generation still hasn't been cracked the same way image has but the above will likely contribute to the solution to that as well. Anyone who's intersted in working on that feel free to message me.
tomthe 4y ago
From the cherry-picked example-images on that page, it seems like Imagen more closely follows the prompt than the open Stable Diffusion model[0]. Stable Diffusion needs a lot of hints before it makes out of the ordinary pictures. In general, I think these models are a great and funny toy, but not a threat to stock-photos yet. This may change within a year or three years though. [0]:https://stability.ai/blog/stable-diffusion-announcement https://stability.ai/blog/stable-diffusion-announcement
- culi 4y ago
  Not a threat to stock photos? That's exactly what they are. Look at these photos from the Midjourney Discord today: crystal dragon thing: https://cdn.discordapp.com/attachments/951197655021797436/1009511356342489138/1.png https://cdn.discordapp.com/attachments/951197655021797436/10... https://cdn.discordapp.com/attachments/951197655021797436/1009511359131693056/14.png https://cdn.discordapp.com/attachments/951197655021797436/10... https://cdn.discordapp.com/attachments/951197655021797436/1009511358745804881/13.png https://cdn.discordapp.com/attachments/951197655021797436/10... davinci-style notebook of flying machines: https://cdn.discordapp.com/attachments/1008049109338443829/1011122626833420298/20220708_013655.jpg https://cdn.discordapp.com/attachments/1008049109338443829/1... https://cdn.discordapp.com/attachments/1008049109338443829/1011122627772940398/20220708_025002.jpg https://cdn.discordapp.com/attachments/1008049109338443829/1... this person tried to show the life cycle of an alien: https://cdn.discordapp.com/attachments/1010211132671275058/1010954794912981002/01.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954795298852995/02.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954795961561138/04.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954796657807410/06.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... cavemen taking a group selfie (lots of faces) https://cdn.discordapp.com/attachments/1011408429170044928/1011620969544159393/fifty_35mm_close-up_photo_of_faces_of_cavemen_taking_a_group_se_63e714d1-b5a8-43d3-9025-486bb6f0f8be.png https://cdn.discordapp.com/attachments/1011408429170044928/1...
  - sh4rks 4y ago
colordrops 4y ago
Is Google going to share or do something other than better advertising with this? What do they plan to do with it? I'm frankly tired of these show-off blog posts by Google that neither make it into general hands nor are used for anything positive. This is just a link to their previous posted site btw, nothing new.
- stevewatson301 4y ago
  My guess is they're they'll use Imagen and LaMDA to build a "conversational" search experience of some kind. So, instead of providing a list of websites to go to, they'll synthesize an answer to the search query, with imagery to go along with it, and so on.
  - fvold 4y ago
    I don't know about the market at large, but I do not want that. I want the a search engine to just have a huge database of websites, and look up stuff in that database based on my query, spitting out a link to the page that matches best, then the one that matches second best etc etc. Using ML to determine the order of matches is absolutely fine, but to "digest" the internet and cook up an answer to what I'm looking for without proper sourcing? I do not want that. I don't want to try and guess what biases the language model might have. It's way easier for me to gauge the bias of another human, and for that, I need to be sent to a page a human has written. (Of course, I realize that the "blog written by a bot" genre of writing is also becoming more convincing, making this whole thing harder...)
    - dumpsterlid 4y ago
      Yah I would love someone to convince me this isn't like touchscreen interfaces becoming prevalent in cars over physical control surfaces. It is sold as technological advancement that is good for everyone but in reality it is just corporations figuring out how to make something worse for cheaper and force consumers into it. I already feel like google search sucks. It is partially googles fault partially the internets fault. The best source of information was and will always be forums full of knowledgable people having genuine conversations and everybody moved to discord because.... because... om I dont know and besides google doesnt get paid to elevate tiny ass forum websites in the search results.
panabee 4y ago
past threads: * https://news.ycombinator.com/item?id=31484562 https://news.ycombinator.com/item?id=31484562 * https://news.ycombinator.com/item?id=32589185 https://news.ycombinator.com/item?id=32589185
- schappim 4y ago
  Is this being reported as "new news" because it is available to the public?
  - glenneroo 4y ago
    AFAIK nothing is released yet? They are probably still trying to, like Dall-E 1/2, remove every every image and ban every word that might generate even the slightest hint of controversial imagery before releasing it to the public. To be fair, Stable Diffusion spent months basically doing the same on Discord with thousands of beta users, and had an army of moderators flagging images which were subsequently removed in order to prevent people from generating porn. Didn't help though, as people got access to the beta models (for "research" purposes) a few weeks before the official release and are using that to e.g. create "porn"[0]. [0] pornpen.ai: https://news.ycombinator.com/item?id=32572770 https://news.ycombinator.com/item?id=32572770
    - astrange 4y ago
      Even if you don’t want to block generating porn, you still want to know if you’re getting it, because nobody wants to get porn when they didn’t ask for it. (and it may be illegal depending on your country) It’s easy to remove the filter from the SD scripts and that’s intentional.
      - glenneroo 4y ago
        Fair enough and props to Stability for giving people the benefit of the doubt, not to mention actually open sourcing almost all of their work, unlike other "open" projects. Speaking of which, Dall-E bans a decent chunk of the English dictionary in the hopes of preventing people from generating anything even remotely offensive, which can be somewhat frustrating.
mshenfield 4y ago
These tools are amazing for prototyping. I had an idea for a promotional poster, and seeing my idea just by writing it felt like magic. The generated image had too many artifacts to use, but gave me a guideline to follow when creating the real thing in Pixlr. AI content generation (text, image, source code, video, music) will be a huge boon for prototyping where applied judiciously.
- fvold 4y ago
  Yep, I feel that exact way about Nvidia Canvas [1]. It does not produce anything even close to usable as a final product, but it can produce an amazing start to a concept. [1] https://www.nvidia.com/en-us/studio/canvas/ https://www.nvidia.com/en-us/studio/canvas/
  - keizo 4y ago
    wow, that's kinda insane and almost looks more fun for those of us short on words.
- hackernewds 4y ago
  > Creating the real thing in Pixlr is it that good now? note that Pixlr was bought by Google
  - IvanK_net 4y ago
    Pixlr was not bought by Google. So many people spreading lies on the internet :(
  - mshenfield 4y ago
    I like Pixlr, I use pixlr.com/e. It's free and web based and has always worked well for me. Did that happen recently? It says in Pixlr's site they're owned by INMAGINE.
- echelon 4y ago
  Google hasn't released squat. Google's product is vaporware and we shouldn't afford them any airtime until they release something usable. They're just trying to butt in and get press off of the backs of the teams actually working in the open, and that's super lame. Release your model, Google, or stop bragging and talking over the others here. You're greedily sucking oxygen out of the conversation, and as a trillion dollar monopoly you don't deserve anything for free off of the backs of others. Not when you're not contributing. Stop being the rich kid talking over everyone else about how awesome your toys are. Anyhow, the real story is Stable Diffusion. They're actively demonstrating the correct way to run this as opposed to the entirely closed OpenAI DALL-E or the (again vaporware) Google non-product. Even MidJourney uses Stable Diffusion under the hood, using sophisticated prompt engineering to make their product distinct and powerful.
curiousssnake 4y ago
There are some obvious mistakes in tools like this. Such as: Human faces are wrong, writing is usually scrambled, fingers look weird etc... Do you know if we need to have a major breakthrough similar to what happened 6 months ago to fix this or could these be fixed with incremental improvements in current techniques / datasets?
- FairlyInvolved 4y ago
  I wouldn't necessarily say a major breakthrough as such but I do think some architectural change is needed. There are concepts in images that we don't rely on purely visual understanding for - like words, we have a language model that we use to rely on when we see text in images. I think we need the same thing in our models to reach the next level of capabilities by combining models across different domains. I don't know if this manifests as pre-training with a language model and then expanding and updating the tensors as part of image training, or some more complicated merger of the models. To learn logical concepts just from images seems entirely impractical, like we can't rely on having enough images such that models can understand words coherently as language. You could draw a picture of a sign that says "children crossing" not because you can understand and remember exactly what an image of such a sign would look like, but because you have an understand of English and the character set that would let you reproduce it. If you tried to learn to create the same sign in Arabic you'd either need to see a huge number of signs to learn from or (more likely) build a language model for Arabic. The kind of abstract understandings that we know we can train in language models just aren't learned by image transformers at this scale (or likely any practical scale). A language model could easily understand: "A red cube is stacked on top of a blue plate, a green pyramid is balanced on the red cube" and infer things like the position of the pyramid relative to the blue plate, image models quickly fall over with such examples. An interesting nascent (and hacky) example of the benefits of combining models is people are using language models like GPT-3 to create better prompts for image models.
- andrewshadura 4y ago
  On the other hand, those are all things humans have troubles with when drawing, unless they have an extraordinary talent or a lot of experience.
boppo1 4y ago
Why is this text-based image research advancing so rapidly? Is there a market application they're aiming for? Seems like multiple teams have been on multiple models and I see a new one every week.
- tiborsaas 4y ago
  It's like a love child of Photoshop and Polaroids with the simplicity of writing text. It would have been amazing if it didn't became popular.
- ShamelessC 4y ago
  It’s basically the first time we’ve automated perception of vision as it relates semantically with language. In terms of theory, such systems are candidates for a generic perception engine you might use in say, a robot with cameras, speaker and a microphone. Perception is just one aspect of intelligence, but this research ultimately makes it possible for a machine to encode data semantically.
dannyw 4y ago
Model weights or shut up.
de6u99er 4y ago
GPT-3(4), DALL-E, Imagen, ... I wonder what's next?
- trention 4y ago
  Diminishing returns.
- drumhead 4y ago
  Sound and moving images. Put it all together and fan fiction will never be the same again! But seriously it may usher in a new cottage industry of content creation, from graphic novels,to animation to movies.
- zackmorris 4y ago
  The indignation of still having to go to work every day when this could all be automated
- TaupeRanger 4y ago
  Hopefully something that actually matters for humanity, and less "game playing" and "stock image market disrupting".
mjan22640 4y ago
Is there an AI that creates realistic text from photos?
- glenneroo 4y ago
  Look into image-to-text or CLIP captioning. There are several tools out there, although similar to running text-to-image tools locally, may require some time to setup via conda. The easiest way that I know of (currently) would be install Visions of Chaos. You will still need to follow the TensorFlow setup guide[0] which will take 1-2 hours, then, running Visions of Chaos > Mode > Machine Learning will download 3-400GB of models in order to be able to run all the available tools they have integrated, even if you aren't interested in most of them. The setup may require several retries and several hours due to some servers being extremely slow (or overloaded). EDIT: Just found this[1] as well, though setup might also be a pain. [0] https://softology.pro/tutorials/tensorflow/tensorflow.htm https://softology.pro/tutorials/tensorflow/tensorflow.htm [1] https://replicate.com/methexis-inc/img2prompt https://replicate.com/methexis-inc/img2prompt
- Jach 4y ago
  Sort of. https://github.com/pharmapsychotic/clip-interrogator https://github.com/pharmapsychotic/clip-interrogator
- astrange 4y ago
  iOS is pretty good at it if you enable VoiceOver. Microsoft has an app called Seeing Eye that’s not as good at it. Both of those use older pre-CLIP technology.
TheLudd 4y ago
2014: I made a new javascript framework! 2022: I made a new AI image generator!
Nursie 4y ago
I feel like Imagen gets all the noise and people forget about Parti - https://parti.research.google/ https://parti.research.google/ It's another google project using a different set of techniques.
- natch 4y ago
  I just ignore Google projects since they don’t get released… and when they are released it’s with such severe limitations that they don’t work well.
- astrange 4y ago
  That’s because nobody cares that they got a slightly worse result with a different model architecture. Especially the pictures aren’t as sharp, so they’re not as fun to look at. Parti+Imagen is in development and is competitive again.
Roark66 4y ago
Every single time I see an article about a new AI model that has a section called "societal impact" I know immediately they are not releasing the model, the training set, nothing... It seems to be the kind of bullshit statement that those companies put in place of "we paid $500k training this model and we're not giving it for free to anyone".
- SXX 4y ago
  Fortunately we have Stability.AI and they release their image generation model already. Hopefully they'll follow with other projects too. https://stability.ai/blog/stable-diffusion-public-release https://stability.ai/blog/stable-diffusion-public-release
  - colordrops 4y ago
    Much respect to Stability - they followed through on their promise.
  - prophesi 4y ago
    There's also a fork that requires a lot less VRAM. I was able to get this working with an Nvidia GTX 1070. https://github.com/basujindal/stable-diffusion https://github.com/basujindal/stable-diffusion You'd clone the fork, then download Stability AI's checkpoint, sd-v1-4.ckpt, from https://huggingface.co/CompVis/stable-diffusion-v-1-4-original https://huggingface.co/CompVis/stable-diffusion-v-1-4-origin... Follow the instructions in the forked repo, and you should be good to go in a manner of minutes.
    - acoard 4y ago
      The only issue I had was WSL 2 was not using my GPU, so obviously it failed. Couldn't get it working on Windows either, failed at installing dependencies. I'm thinking of dual-booting Linux just to try out stable-diffusion. I normally dev on Linux but don't do GPU work, only my Windows gaming PC has the horsepower to run stable-diffusion and unfortunately I couldn't get it working on Windows. Shame cause I'd love to play around with it! Does anyone have any tips?
mupuff1234 4y ago
A bit off topic, but looking the stable diffusion site there's barely any mention of the people behind the project which I find odd yet refreshing.
diziet 4y ago
A photo of a Shiba Inu dog wearing a sunglasses and black leather jacket playing a guitar in a garden, does not work correctly.
danwee 4y ago
Coming from Google? No thanks. If we are already being screwed by simple services like YouTube, I cannot imagine how screwed up we'll be when we become addicted to services that rely on the research posted on the article. Coming from Google, it's probably only good for Google, not for its potential customers/users/slaves.
bmitc 4y ago
What is the purpose of these new AI photo generators besides crime, impersonation, or advertising? People seem really excited by them, but I don't get it.
- woojoo666 4y ago
  Check out this artist on youtube that uses Midjourney to draw something in 20 minutes that would usually take him hours: https://www.youtube.com/watch?v=EsQgD9yNMxU https://www.youtube.com/watch?v=EsQgD9yNMxU
- indy 4y ago
  It's a creative outlet, it's art, it's fun.
sheilaalien 4y ago
I'm surprised how very little this forum and the public in general knows or understands about the current capabilities and availability to these ai art generators. You have midjourney.com beta.dreamstudio.ai craiyon.com (real quick version no fuss, low quality) creator.nightcafe.studio and those are just some of the entry-level ones. I make ai art all day long! Check out my media feed on twitter @Sheilaaliens
- lm28469 4y ago
  > I make ai art all day long! I feel like this is the epitome of modern "content creation" Typing a few sentences into a software you barely understand, said software shits 15 jpegs out, 2 are good, "hey I make art". What a sad state of affair, tech is consuming everything and people are cheering, one more step on the path to being complete useless key pressers.
  - ShamelessC 4y ago
    I’m not crazy about the tone you’re striking, but the bit about “software you barely understand” does ring true. Lots of folks who think hitting play in a notebook makes them some sort of AI-art-engineer these days. On the other hand, the whole point of automating creation is that you don’t need to understand the underlying mechanisms.
    - HPsquared 4y ago
      It's division of labour. The toolmaker has a different set of skills to the user of the tools.
      - leetrout 4y ago
        Somewhat related, that made me think if pioneers, settlers and town planners https://medium.com/org-hacking/pioneers-settlers-town-planners-wardley-9dcd3709cde7 https://medium.com/org-hacking/pioneers-settlers-town-planne...
      - lm28469 4y ago
tgv 4y ago
For all those who are practically demanding this be turned over to them, here's a quote from a recent article (about Telegram): Filing a charge is pointless, says Ezra. Since two years, she's being harassed on Telegram. It started when she was sixteen: photoshopped nudes with her snapchat account were circulated. They had taken selfies from her social media, and those of her family, and combined them with porn fragments. She doesn't know the perpetrator, but that person takes a lot of trouble to ruin her. "Nowadays, the boys have so many ways to make it look real." [1] If you read that, and think all these tools should be released, you're part of the problem. [1] de Groene Amsterdammer,146/33, p. 21.
- LudwigNagasena 4y ago
  > If you read that, and think all these tools should be released, you're part of the problem. Such comments make me wonder whether a social credit system is actually a good idea. Yes, it can be abused to deny my rights, but how can it be worse than being assumed to be a sexual predator by default?
  - tgv 4y ago
    Nobody assumes that. But if you give it away to literally everybody that asks for it, you'd be worse than naive to assume that nobody is going to abuse it. But your comment makes it sound as if you'd rather give up your rights than not have access to this system. I don't think it's that interesting, is it?
latexr 4y ago
The angle and framing is the same in all images. They all have a stock photo vibe.
andy_ppp 4y ago
Woah, it’s certainly going to be trippy when the AI is animating this in VR for us and maybe even listening to us direct the game/world.
napolux 4y ago
Is anyone aware of people doing the same for NSFW images? They can easily wipe out an entire industry. No models to pay and to check for legal ages, infinite possibilities: just write the pic you want, the massive body part you want, how many genitals are involved and boom. You have your image.
- Mumps 4y ago
  [0] Was front page recently. [0] (OBVIOUSLY NSFW) https://news.ycombinator.com/item?id=32572770 https://news.ycombinator.com/item?id=32572770
  - oezi 4y ago
    This certainly begs the question: When does DALLE2 become viable to generate movie clips of up to 10 minutes in length? 10 min * 60 * 24 FPS = 14400 images ~ 2^13 So maybe 10 years?
  - napolux 4y ago
    Thanks!
  - napolux 4y ago
    Looks like there’s a lot of road ahead for this, but def. A starting point
- staticassertion 4y ago
  I agree, it does seem like this makes a lot of sense for the adult industry. But seemingly all of the models that get released have a built in censor for that sort of thing from what I understand.
- canoebuilder 4y ago
  - canoebuilder 4y ago
    I speak from a place of compassion. Let’s make it past the Great Filter, our descendants at least, and not wank ourselves to death.
vyrotek 4y ago
Is the next thing going to be image generation trained on your own photos? It seems like personalized generation would be a huge market. Ex. Show me walking on a beach. Show my dog wearing sunglasses, etc.
- LelouBil 4y ago
  You might want to look at this : https://textual-inversion.github.io/ https://textual-inversion.github.io/ It allows you to find a string that corresponds to some "thing" you have pictures of. Then you can use a text to image model containing a reference to your "thing". Looks pretty amazing! However it needs 20gb of VRAM so I couldn't try it out.
cdcox 4y ago
This is amazing but Google/OpenAI haven't released their models and don't seem to plan to. There is stable diffusion which was released and is probably slightly less good but still good if anyone wants to mess with it. There is a huggingface instance, Collab notebooks, and local running notebooks here. [1] on the stable diffusion subreddit. Also someone has packaged an exe that runs it with no fuss on computers with Nvidia GPUs that they posted on the media synthesis subreddit[0] In my limited testing this compares ok to Dalle2. Style shifting works slightly less well and it's hard to force it away from normal images but with a little work it tends to be more accurate to your prompt. [0] https://grisk.itch.io/stable-diffusion-gui https://grisk.itch.io/stable-diffusion-gui [1] https://www.reddit.com/r/StableDiffusion/comments/wqaizj/list_of_stable_diffusion_systems https://www.reddit.com/r/StableDiffusion/comments/wqaizj/lis...
dang 4y ago
Imagen, a text-to-image diffusion model - https://news.ycombinator.com/item?id=31484562 https://news.ycombinator.com/item?id=31484562 - May 2022 (634 comments)
evronm 4y ago
Did anyone think illustrators would lose their jobs to AI before e.g. cab drivers? I wouldn't have guessed that in a million years. Singularity upon us or just quirky development in an already weird field?
ThinkBeat 4y ago
These things keep showing up latetly in various forms. A day or two about it was creating image of a porno star. But always a sometimes good sometimes crappy web app you can test it out, but usualy it is very limited or not possible. The porn star one said it had used up its resource, and this one I cant figure out if i can run it. I get spreadsheet from the linkm but I am unsure how it helps me. As a guy who does not know a lot of "AI" are these things just showing they "Hey I trained this then to do ...... / I have a big data model"? Is there a standard way to share it? If you start out with 10.000 penguins to teach a model about penguins. Once the model has worked through it, do you have any more use of the images separately? How large are the models?

293 points by fagnerbrack 4y ago

This will be nice when a person wants a custom item tailor made to describe visually what it should look like and verify the picture before sending over. Taking that idea further into the future, we can clearly see how speech-to-text and dynamic adjustments coupled with 3d printing could lead.

anshul 4y ago

Does anyone know if or when google intends to make this available for beta testing or public use?

carrozo 4y ago
Towards the bottom of the page they say: “The potential risks of misuse raise concerns regarding responsible open-sourcing of code and demos. At this time we have decided not to release code or a public demo. In future work we will explore a framework for responsible externalization that balances the value of external auditing with the risks of unrestricted open-access.”
- Traubenfuchs 4y ago
  Are they afraid of lawsuits or are they painfully regressive, prude moralists? Stable diffusion was un-neutered within 24 hours of its public release and the worst people do with it is Emma Watson porn.
  - shmageggy 4y ago
    It's not about prudishness, although generating pornography is one of the concerns. In the paper there's a full page on ethical concerns, but some of issues they mention are misinformation, and perpetuating harmful cultural stereotypes around race and/or gender roles.
  - mook 4y ago
    Or they just remember Microsoft Tay: https://en.wikipedia.org/wiki/Tay_(bot) https://en.wikipedia.org/wiki/Tay_(bot)
  - zo1 4y ago
    In a nutshell they're afraid of people using prompts generating black people looking like monkeys/gorillas. And other such sensitive examples that others have posted/mentioned.
- quitit 4y ago
  While I understand that view, pandora’s box is already open, by their own measurements other publicly-available technology is comparable: so the only thing they’re stopping with this is direct comparison of their tech to others. A more cynical side of me just thinks Google is rushing out the PR (including the hand-plucked sample images) because they can see that the state of the tech is progressing rapidly and perhaps by the time their tech is release-ready a competitor will already have something better (the new round of betas certainly look promising.) It is a little bit on brand for Google to make an announcement they have the best, only for those claims to fall over later.
- aantix 4y ago
  By the time they figure out the "responsible externalization" portion, competitors (including open source) will surpass their results. The technology isn't special to Google. They don't control its proliferation.
indy 4y ago
They're probably afraid that people will generate images that don't conform to the current American Progressive Vision.

polotics 4y ago

Not a single human face in these samples. I wonder how well it does on faces.

tmikaeld 4y ago
I’m also curious. The animal faces and eyes look good, less creepy than most.
8n4vidtmkvmk 4y ago
have you seen https://thispersondoesnotexist.com/ https://thispersondoesnotexist.com/ ? that's old already. different tech tho
andresgottlieb 4y ago
Saul Goodman if he was a character in Twin Peaks: https://media.discordapp.net/attachments/999426920376717513/1011642719208214528/agottlieb_Saul_Goodman_as_a_character_in_Twin_Peaks_HDR_4K_f931186a-233e-4a70-86c8-76a78098d43f.png https://media.discordapp.net/attachments/999426920376717513/... Generated with Midjourney Beta
- glenneroo 4y ago
  Which is now Stable Diffusion under the hood, sprinkled with a little prompt parsing "magic".
  - Terretta 4y ago
    This may be misleading. As far as I could tell (using it before, during, and after this Beta option was available) it was the upscalar using that, not the original 4 image generation.
ansible 4y ago
The samples I was shown definitely had a theme: robots, raccoons, hats, and raccoons wearing hats. Our brains are very thoroughly wired to detect faces in general, and flaws in faces. So we have a very, very high standard for what passes muster. We are apparently much more forgiving with regards to what raccoons and corgis look like.

bottlepalm 4y ago

Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder what’s next.

culi 4y ago
People are getting into "prompt-craft". People have also started pasting different AI tools together like putting these images into CogVideo[0] to generate actual videos (takes ages and usually the length of a gif currently). Others have realized you can run these images through GANs to make faces look extremely convincing I think "what's next" is fitting these tools together in a larger system [0] https://replicate.com/nightmareai/cogvideo https://replicate.com/nightmareai/cogvideo
- bottlepalm 4y ago
  Ok I’m just going to list ideas, feel free to add more * Text to 3d model * Text to video clip * Illustrations for newspapers * Generating pictures for food menus * Generating a music video from a song * Generating pictures or even an entire movie for a book * Interior design ideas * Product design ideas I have noticed that leveraging these tools isn’t easy. It requires a fair bit of creativity to come up with the prompts to create an image to really wow somebody.
  - culi 4y ago
    Someone on the midjourney discord is making a comic with images generated by the bot. Another person is making a Magic The Gathering card pack with generated art (it looks good too!). People are already using it for stock photos One murky area we're still far away from but I'm curious to follow the developments on: AI-generated movies. Once generated clips gets good, what if some movie buff can just generate a movie, scene-by-scene, just using these tools? What about "casting" certain celebrities? The comic I mentioned uses Zendaya (probably because she plays a character in the Dune movies) as a character
    - 4y ago

NationOfJoe 4y ago

i only have a passing curiosity in these projects personally. can someone in the field explain why this has exploded recently? there seems to be a lot of these tools released recently (text to image) was there a major breakthrough? a new idea that pushed everyone forward? a recent sharing of talent between groups? edit: just another thought, are they just being posted to HN now, i don't see a date on the page for when it was released . I also don't know the general term to find a list of all of these to find all the release dates

Rebelgecko 4y ago
Not in the field, but maybe diffusion models? They seem to be used by a lot of different image generation techniques.
derac 4y ago
The first major projects were OpenAI's DALL-E, then DALL-E 2 a year later. DALL-E 2 was much much better. After that a few new projects have been released in rapid succession including the open source stable diffusion. Here are some of the projects on GitHub: https://github.com/topics/text-to-image https://github.com/topics/text-to-image Another good source is https://paperswithcode.com/task/text-to-image-generation https://paperswithcode.com/task/text-to-image-generation
rapnie 4y ago
I don't know. This 'explosion' in the public space may just be the technology crossing a threshold where big $$$ are on the table and competitors rushing in to get hold of good chunks of the emerging market. No tech breakthrough, but a marketing & sales assault.
deleted 4y ago
[deleted]
MathYouF 4y ago
Like anyone deeply in a field I know maybe several thousand people who could probably give a better answer, but I figure I'll give an effort to provide one since I don't see any good ones posted yet. The moment everyone knew this was going to be big was in 2019 when StyleGAN came out. They used a lot of tricks like aligning face features (like eyes) and had all their pictures of a single domain (the most famous being faces) but none the less, that was the moment everyone in the AI field knew this was going to be big, and so three years ago a lot of big people shifted to this line of research. The four main innovations since then have been: 1. Transformers Generalized computation kernels which allow for images to consider non-localised relationships between pixels of an image. Released in 2017, and originally used for language. 2. Pixel Patch Encodings Different resolution semantic and geometric image information encodings which allow for better representations of relationships between image areas than pixels are able to achieve given the same compute. Allows using Transformers on high resolution images. 3. CLIP Contrastive Language and Image Pairing. Before, the only way we knew to classify an image was as a "face" or "cat" or "ramen". When the genius idea of labeling images as semantically meaningful vectors rather than one hot encoded classes was revealed, it changed everything in computer vision very quickly, and problems that used to be hard became trivial. Released in 2021 4. Diffusion Models GANs penalise you for making an image which does not seem to be part of an existing dataset. This encourages one to make the worst quality image that looks like a member of that dataset. Diffusion learns to denoise an image, removing noise is perceptually similar to increasing resolution, people like images that look that way. There may be more people with better intuition about diffusion models may be able to add on why they're superior. I've read all the papers leading up to the latest unCLIP (Dalle2) but it's complicated. Released in 2020, with major improvements to the training process continuously being made since then. Hope this was helpful. All of the above were only implemented for images in any real way in the last three years. Putting them all together is something many people only just this year did, resulting in DallE, Stable Diffusion, and Imagen. I'm working on doing this for 3D and later for use cases in AR. 3D generation still hasn't been cracked the same way image has but the above will likely contribute to the solution to that as well. Anyone who's intersted in working on that feel free to message me.

tomthe 4y ago

From the cherry-picked example-images on that page, it seems like Imagen more closely follows the prompt than the open Stable Diffusion model[0]. Stable Diffusion needs a lot of hints before it makes out of the ordinary pictures. In general, I think these models are a great and funny toy, but not a threat to stock-photos yet. This may change within a year or three years though. [0]:https://stability.ai/blog/stable-diffusion-announcement https://stability.ai/blog/stable-diffusion-announcement

culi 4y ago
Not a threat to stock photos? That's exactly what they are. Look at these photos from the Midjourney Discord today: crystal dragon thing: https://cdn.discordapp.com/attachments/951197655021797436/1009511356342489138/1.png https://cdn.discordapp.com/attachments/951197655021797436/10... https://cdn.discordapp.com/attachments/951197655021797436/1009511359131693056/14.png https://cdn.discordapp.com/attachments/951197655021797436/10... https://cdn.discordapp.com/attachments/951197655021797436/1009511358745804881/13.png https://cdn.discordapp.com/attachments/951197655021797436/10... davinci-style notebook of flying machines: https://cdn.discordapp.com/attachments/1008049109338443829/1011122626833420298/20220708_013655.jpg https://cdn.discordapp.com/attachments/1008049109338443829/1... https://cdn.discordapp.com/attachments/1008049109338443829/1011122627772940398/20220708_025002.jpg https://cdn.discordapp.com/attachments/1008049109338443829/1... this person tried to show the life cycle of an alien: https://cdn.discordapp.com/attachments/1010211132671275058/1010954794912981002/01.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954795298852995/02.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954795961561138/04.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... https://cdn.discordapp.com/attachments/1010211132671275058/1010954796657807410/06.jpg https://cdn.discordapp.com/attachments/1010211132671275058/1... cavemen taking a group selfie (lots of faces) https://cdn.discordapp.com/attachments/1011408429170044928/1011620969544159393/fifty_35mm_close-up_photo_of_faces_of_cavemen_taking_a_group_se_63e714d1-b5a8-43d3-9025-486bb6f0f8be.png https://cdn.discordapp.com/attachments/1011408429170044928/1...
- sh4rks 4y ago

colordrops 4y ago

Is Google going to share or do something other than better advertising with this? What do they plan to do with it? I'm frankly tired of these show-off blog posts by Google that neither make it into general hands nor are used for anything positive. This is just a link to their previous posted site btw, nothing new.

stevewatson301 4y ago
My guess is they're they'll use Imagen and LaMDA to build a "conversational" search experience of some kind. So, instead of providing a list of websites to go to, they'll synthesize an answer to the search query, with imagery to go along with it, and so on.
- fvold 4y ago
  I don't know about the market at large, but I do not want that. I want the a search engine to just have a huge database of websites, and look up stuff in that database based on my query, spitting out a link to the page that matches best, then the one that matches second best etc etc. Using ML to determine the order of matches is absolutely fine, but to "digest" the internet and cook up an answer to what I'm looking for without proper sourcing? I do not want that. I don't want to try and guess what biases the language model might have. It's way easier for me to gauge the bias of another human, and for that, I need to be sent to a page a human has written. (Of course, I realize that the "blog written by a bot" genre of writing is also becoming more convincing, making this whole thing harder...)
  - dumpsterlid 4y ago
    Yah I would love someone to convince me this isn't like touchscreen interfaces becoming prevalent in cars over physical control surfaces. It is sold as technological advancement that is good for everyone but in reality it is just corporations figuring out how to make something worse for cheaper and force consumers into it. I already feel like google search sucks. It is partially googles fault partially the internets fault. The best source of information was and will always be forums full of knowledgable people having genuine conversations and everybody moved to discord because.... because... om I dont know and besides google doesnt get paid to elevate tiny ass forum websites in the search results.

panabee 4y ago

past threads: * https://news.ycombinator.com/item?id=31484562 https://news.ycombinator.com/item?id=31484562 * https://news.ycombinator.com/item?id=32589185 https://news.ycombinator.com/item?id=32589185

schappim 4y ago
Is this being reported as "new news" because it is available to the public?
- glenneroo 4y ago
  AFAIK nothing is released yet? They are probably still trying to, like Dall-E 1/2, remove every every image and ban every word that might generate even the slightest hint of controversial imagery before releasing it to the public. To be fair, Stable Diffusion spent months basically doing the same on Discord with thousands of beta users, and had an army of moderators flagging images which were subsequently removed in order to prevent people from generating porn. Didn't help though, as people got access to the beta models (for "research" purposes) a few weeks before the official release and are using that to e.g. create "porn"[0]. [0] pornpen.ai: https://news.ycombinator.com/item?id=32572770 https://news.ycombinator.com/item?id=32572770
  - astrange 4y ago
    Even if you don’t want to block generating porn, you still want to know if you’re getting it, because nobody wants to get porn when they didn’t ask for it. (and it may be illegal depending on your country) It’s easy to remove the filter from the SD scripts and that’s intentional.
    - glenneroo 4y ago
      Fair enough and props to Stability for giving people the benefit of the doubt, not to mention actually open sourcing almost all of their work, unlike other "open" projects. Speaking of which, Dall-E bans a decent chunk of the English dictionary in the hopes of preventing people from generating anything even remotely offensive, which can be somewhat frustrating.

mshenfield 4y ago

These tools are amazing for prototyping. I had an idea for a promotional poster, and seeing my idea just by writing it felt like magic. The generated image had too many artifacts to use, but gave me a guideline to follow when creating the real thing in Pixlr. AI content generation (text, image, source code, video, music) will be a huge boon for prototyping where applied judiciously.

fvold 4y ago
Yep, I feel that exact way about Nvidia Canvas [1]. It does not produce anything even close to usable as a final product, but it can produce an amazing start to a concept. [1] https://www.nvidia.com/en-us/studio/canvas/ https://www.nvidia.com/en-us/studio/canvas/
- keizo 4y ago
  wow, that's kinda insane and almost looks more fun for those of us short on words.
hackernewds 4y ago
> Creating the real thing in Pixlr is it that good now? note that Pixlr was bought by Google
- IvanK_net 4y ago
  Pixlr was not bought by Google. So many people spreading lies on the internet :(
- mshenfield 4y ago
  I like Pixlr, I use pixlr.com/e. It's free and web based and has always worked well for me. Did that happen recently? It says in Pixlr's site they're owned by INMAGINE.
echelon 4y ago
Google hasn't released squat. Google's product is vaporware and we shouldn't afford them any airtime until they release something usable. They're just trying to butt in and get press off of the backs of the teams actually working in the open, and that's super lame. Release your model, Google, or stop bragging and talking over the others here. You're greedily sucking oxygen out of the conversation, and as a trillion dollar monopoly you don't deserve anything for free off of the backs of others. Not when you're not contributing. Stop being the rich kid talking over everyone else about how awesome your toys are. Anyhow, the real story is Stable Diffusion. They're actively demonstrating the correct way to run this as opposed to the entirely closed OpenAI DALL-E or the (again vaporware) Google non-product. Even MidJourney uses Stable Diffusion under the hood, using sophisticated prompt engineering to make their product distinct and powerful.

curiousssnake 4y ago

There are some obvious mistakes in tools like this. Such as: Human faces are wrong, writing is usually scrambled, fingers look weird etc... Do you know if we need to have a major breakthrough similar to what happened 6 months ago to fix this or could these be fixed with incremental improvements in current techniques / datasets?

FairlyInvolved 4y ago
I wouldn't necessarily say a major breakthrough as such but I do think some architectural change is needed. There are concepts in images that we don't rely on purely visual understanding for - like words, we have a language model that we use to rely on when we see text in images. I think we need the same thing in our models to reach the next level of capabilities by combining models across different domains. I don't know if this manifests as pre-training with a language model and then expanding and updating the tensors as part of image training, or some more complicated merger of the models. To learn logical concepts just from images seems entirely impractical, like we can't rely on having enough images such that models can understand words coherently as language. You could draw a picture of a sign that says "children crossing" not because you can understand and remember exactly what an image of such a sign would look like, but because you have an understand of English and the character set that would let you reproduce it. If you tried to learn to create the same sign in Arabic you'd either need to see a huge number of signs to learn from or (more likely) build a language model for Arabic. The kind of abstract understandings that we know we can train in language models just aren't learned by image transformers at this scale (or likely any practical scale). A language model could easily understand: "A red cube is stacked on top of a blue plate, a green pyramid is balanced on the red cube" and infer things like the position of the pyramid relative to the blue plate, image models quickly fall over with such examples. An interesting nascent (and hacky) example of the benefits of combining models is people are using language models like GPT-3 to create better prompts for image models.
andrewshadura 4y ago
On the other hand, those are all things humans have troubles with when drawing, unless they have an extraordinary talent or a lot of experience.

boppo1 4y ago

Why is this text-based image research advancing so rapidly? Is there a market application they're aiming for? Seems like multiple teams have been on multiple models and I see a new one every week.

tiborsaas 4y ago
It's like a love child of Photoshop and Polaroids with the simplicity of writing text. It would have been amazing if it didn't became popular.
ShamelessC 4y ago
It’s basically the first time we’ve automated perception of vision as it relates semantically with language. In terms of theory, such systems are candidates for a generic perception engine you might use in say, a robot with cameras, speaker and a microphone. Perception is just one aspect of intelligence, but this research ultimately makes it possible for a machine to encode data semantically.

dannyw 4y ago

Model weights or shut up.

de6u99er 4y ago

GPT-3(4), DALL-E, Imagen, ... I wonder what's next?

trention 4y ago
Diminishing returns.
drumhead 4y ago
Sound and moving images. Put it all together and fan fiction will never be the same again! But seriously it may usher in a new cottage industry of content creation, from graphic novels,to animation to movies.
zackmorris 4y ago
The indignation of still having to go to work every day when this could all be automated
TaupeRanger 4y ago
Hopefully something that actually matters for humanity, and less "game playing" and "stock image market disrupting".

mjan22640 4y ago

Is there an AI that creates realistic text from photos?

glenneroo 4y ago
Look into image-to-text or CLIP captioning. There are several tools out there, although similar to running text-to-image tools locally, may require some time to setup via conda. The easiest way that I know of (currently) would be install Visions of Chaos. You will still need to follow the TensorFlow setup guide[0] which will take 1-2 hours, then, running Visions of Chaos > Mode > Machine Learning will download 3-400GB of models in order to be able to run all the available tools they have integrated, even if you aren't interested in most of them. The setup may require several retries and several hours due to some servers being extremely slow (or overloaded). EDIT: Just found this[1] as well, though setup might also be a pain. [0] https://softology.pro/tutorials/tensorflow/tensorflow.htm https://softology.pro/tutorials/tensorflow/tensorflow.htm [1] https://replicate.com/methexis-inc/img2prompt https://replicate.com/methexis-inc/img2prompt
Jach 4y ago
Sort of. https://github.com/pharmapsychotic/clip-interrogator https://github.com/pharmapsychotic/clip-interrogator
astrange 4y ago
iOS is pretty good at it if you enable VoiceOver. Microsoft has an app called Seeing Eye that’s not as good at it. Both of those use older pre-CLIP technology.

TheLudd 4y ago

2014: I made a new javascript framework! 2022: I made a new AI image generator!

Nursie 4y ago

I feel like Imagen gets all the noise and people forget about Parti - https://parti.research.google/ https://parti.research.google/ It's another google project using a different set of techniques.

natch 4y ago
I just ignore Google projects since they don’t get released… and when they are released it’s with such severe limitations that they don’t work well.
astrange 4y ago
That’s because nobody cares that they got a slightly worse result with a different model architecture. Especially the pictures aren’t as sharp, so they’re not as fun to look at. Parti+Imagen is in development and is competitive again.

Roark66 4y ago

Every single time I see an article about a new AI model that has a section called "societal impact" I know immediately they are not releasing the model, the training set, nothing... It seems to be the kind of bullshit statement that those companies put in place of "we paid $500k training this model and we're not giving it for free to anyone".

SXX 4y ago
Fortunately we have Stability.AI and they release their image generation model already. Hopefully they'll follow with other projects too. https://stability.ai/blog/stable-diffusion-public-release https://stability.ai/blog/stable-diffusion-public-release
- colordrops 4y ago
  Much respect to Stability - they followed through on their promise.
- prophesi 4y ago
  There's also a fork that requires a lot less VRAM. I was able to get this working with an Nvidia GTX 1070. https://github.com/basujindal/stable-diffusion https://github.com/basujindal/stable-diffusion You'd clone the fork, then download Stability AI's checkpoint, sd-v1-4.ckpt, from https://huggingface.co/CompVis/stable-diffusion-v-1-4-original https://huggingface.co/CompVis/stable-diffusion-v-1-4-origin... Follow the instructions in the forked repo, and you should be good to go in a manner of minutes.
  - acoard 4y ago
    The only issue I had was WSL 2 was not using my GPU, so obviously it failed. Couldn't get it working on Windows either, failed at installing dependencies. I'm thinking of dual-booting Linux just to try out stable-diffusion. I normally dev on Linux but don't do GPU work, only my Windows gaming PC has the horsepower to run stable-diffusion and unfortunately I couldn't get it working on Windows. Shame cause I'd love to play around with it! Does anyone have any tips?

mupuff1234 4y ago

A bit off topic, but looking the stable diffusion site there's barely any mention of the people behind the project which I find odd yet refreshing.

diziet 4y ago

A photo of a Shiba Inu dog wearing a sunglasses and black leather jacket playing a guitar in a garden, does not work correctly.

danwee 4y ago

Coming from Google? No thanks. If we are already being screwed by simple services like YouTube, I cannot imagine how screwed up we'll be when we become addicted to services that rely on the research posted on the article. Coming from Google, it's probably only good for Google, not for its potential customers/users/slaves.

bmitc 4y ago

What is the purpose of these new AI photo generators besides crime, impersonation, or advertising? People seem really excited by them, but I don't get it.

woojoo666 4y ago
Check out this artist on youtube that uses Midjourney to draw something in 20 minutes that would usually take him hours: https://www.youtube.com/watch?v=EsQgD9yNMxU https://www.youtube.com/watch?v=EsQgD9yNMxU
indy 4y ago
It's a creative outlet, it's art, it's fun.

sheilaalien 4y ago

I'm surprised how very little this forum and the public in general knows or understands about the current capabilities and availability to these ai art generators. You have midjourney.com beta.dreamstudio.ai craiyon.com (real quick version no fuss, low quality) creator.nightcafe.studio and those are just some of the entry-level ones. I make ai art all day long! Check out my media feed on twitter @Sheilaaliens

lm28469 4y ago
> I make ai art all day long! I feel like this is the epitome of modern "content creation" Typing a few sentences into a software you barely understand, said software shits 15 jpegs out, 2 are good, "hey I make art". What a sad state of affair, tech is consuming everything and people are cheering, one more step on the path to being complete useless key pressers.
- ShamelessC 4y ago
  I’m not crazy about the tone you’re striking, but the bit about “software you barely understand” does ring true. Lots of folks who think hitting play in a notebook makes them some sort of AI-art-engineer these days. On the other hand, the whole point of automating creation is that you don’t need to understand the underlying mechanisms.
  - HPsquared 4y ago
    It's division of labour. The toolmaker has a different set of skills to the user of the tools.
    - leetrout 4y ago
      Somewhat related, that made me think if pioneers, settlers and town planners https://medium.com/org-hacking/pioneers-settlers-town-planners-wardley-9dcd3709cde7 https://medium.com/org-hacking/pioneers-settlers-town-planne...
    - lm28469 4y ago

tgv 4y ago

For all those who are practically demanding this be turned over to them, here's a quote from a recent article (about Telegram): Filing a charge is pointless, says Ezra. Since two years, she's being harassed on Telegram. It started when she was sixteen: photoshopped nudes with her snapchat account were circulated. They had taken selfies from her social media, and those of her family, and combined them with porn fragments. She doesn't know the perpetrator, but that person takes a lot of trouble to ruin her. "Nowadays, the boys have so many ways to make it look real." [1] If you read that, and think all these tools should be released, you're part of the problem. [1] de Groene Amsterdammer,146/33, p. 21.

LudwigNagasena 4y ago
> If you read that, and think all these tools should be released, you're part of the problem. Such comments make me wonder whether a social credit system is actually a good idea. Yes, it can be abused to deny my rights, but how can it be worse than being assumed to be a sexual predator by default?
- tgv 4y ago
  Nobody assumes that. But if you give it away to literally everybody that asks for it, you'd be worse than naive to assume that nobody is going to abuse it. But your comment makes it sound as if you'd rather give up your rights than not have access to this system. I don't think it's that interesting, is it?

latexr 4y ago

The angle and framing is the same in all images. They all have a stock photo vibe.

andy_ppp 4y ago

Woah, it’s certainly going to be trippy when the AI is animating this in VR for us and maybe even listening to us direct the game/world.

napolux 4y ago

Is anyone aware of people doing the same for NSFW images? They can easily wipe out an entire industry. No models to pay and to check for legal ages, infinite possibilities: just write the pic you want, the massive body part you want, how many genitals are involved and boom. You have your image.

Mumps 4y ago
[0] Was front page recently. [0] (OBVIOUSLY NSFW) https://news.ycombinator.com/item?id=32572770 https://news.ycombinator.com/item?id=32572770
- oezi 4y ago
  This certainly begs the question: When does DALLE2 become viable to generate movie clips of up to 10 minutes in length? 10 min * 60 * 24 FPS = 14400 images ~ 2^13 So maybe 10 years?
- napolux 4y ago
  Thanks!
- napolux 4y ago
  Looks like there’s a lot of road ahead for this, but def. A starting point
staticassertion 4y ago
I agree, it does seem like this makes a lot of sense for the adult industry. But seemingly all of the models that get released have a built in censor for that sort of thing from what I understand.
canoebuilder 4y ago
- canoebuilder 4y ago
  I speak from a place of compassion. Let’s make it past the Great Filter, our descendants at least, and not wank ourselves to death.

vyrotek 4y ago

Is the next thing going to be image generation trained on your own photos? It seems like personalized generation would be a huge market. Ex. Show me walking on a beach. Show my dog wearing sunglasses, etc.

LelouBil 4y ago
You might want to look at this : https://textual-inversion.github.io/ https://textual-inversion.github.io/ It allows you to find a string that corresponds to some "thing" you have pictures of. Then you can use a text to image model containing a reference to your "thing". Looks pretty amazing! However it needs 20gb of VRAM so I couldn't try it out.

cdcox 4y ago

This is amazing but Google/OpenAI haven't released their models and don't seem to plan to. There is stable diffusion which was released and is probably slightly less good but still good if anyone wants to mess with it. There is a huggingface instance, Collab notebooks, and local running notebooks here. [1] on the stable diffusion subreddit. Also someone has packaged an exe that runs it with no fuss on computers with Nvidia GPUs that they posted on the media synthesis subreddit[0] In my limited testing this compares ok to Dalle2. Style shifting works slightly less well and it's hard to force it away from normal images but with a little work it tends to be more accurate to your prompt. [0] https://grisk.itch.io/stable-diffusion-gui https://grisk.itch.io/stable-diffusion-gui [1] https://www.reddit.com/r/StableDiffusion/comments/wqaizj/list_of_stable_diffusion_systems https://www.reddit.com/r/StableDiffusion/comments/wqaizj/lis...

dang 4y ago

Imagen, a text-to-image diffusion model - https://news.ycombinator.com/item?id=31484562 https://news.ycombinator.com/item?id=31484562 - May 2022 (634 comments)

evronm 4y ago

Did anyone think illustrators would lose their jobs to AI before e.g. cab drivers? I wouldn't have guessed that in a million years. Singularity upon us or just quirky development in an already weird field?

ThinkBeat 4y ago

These things keep showing up latetly in various forms. A day or two about it was creating image of a porno star. But always a sometimes good sometimes crappy web app you can test it out, but usualy it is very limited or not possible. The porn star one said it had used up its resource, and this one I cant figure out if i can run it. I get spreadsheet from the linkm but I am unsure how it helps me. As a guy who does not know a lot of "AI" are these things just showing they "Hey I trained this then to do ...... / I have a big data model"? Is there a standard way to share it? If you start out with 10.000 penguins to teach a model about penguins. Once the model has worked through it, do you have any more use of the images separately? How large are the models?