4 ms·

End of the day, unless it's opened up Dall-E 2 will be seen as an evolutionary dead end of this tech and a misstep. It's gone from potentially one of the most

End of the day, unless it's opened up Dall-E 2 will be seen as an evolutionary dead end of this tech and a misstep. It's gone from potentially one of the most innovative companies on the horizon to a dead product now I can spin up equivalent tech on my own machine, hook into my workflow and tools in an afternoon all because Stable Diffusion released their model into the wild.

filoleg 4y ago
Yeah, until Stable Diffusion became available, I felt that Dall-E 2 stance on not opening it up was sorta reasonable. Mostly because "groundbreaking tech producing all these impressive results that cost a ton to build, and I bet stable diffusion announcements were all just riding the hype, and it will disappoint at the end." I have never eaten my words as fast as I did when stable diffusion had finally released. Such a gamechanger while running locally, it isn't even funny. All these parameters and samplers one could play with, use a one-click simple gui or cli or a web front-end or even hook it up to any existing code flow that you have going. And it all just works well, with every week bringing new advancements (like img2img). I haven't heard anyone talk about Dall-E 2 in over a month. Like, at all. All while stable diffusion overtook pretty much every single social circle related to image generation that I was in. Major props to the stable diffusion team. They had a very high bar to reach, and not only they managed to do it extremely fast, they blew way past it. Leading by example, in the face of all the "no no no, we gotta keep the model and everything closed, and you shouldnt be able to run it locally, oh and also we hardcoded input filters because safety and we know better than you do" bs arguments was extremely satisfying to watch.
- capitalsigma 4y ago
  My stable diffusion output looks awful. I've been trying to recreate the xkcd about Joe Biden eating sandwiches, so I try something like "Joe Biden eating a sandwich in the oval office, 4k render, photograph" and I get nightmare fuel with pieces of bread attached to his head, faces that dissolve into random geometric shapes, toppings that melt into hands while a sandwich sits on a plate in front of him, etc. I had high hopes based on posts from the SD subreddit, and I figured Biden would be well represented in the training data. Am I missing something?
  - dickholesalad 4y ago
    You might try using image to image with the comic and previously mentioned prompt as inputs.
  - CuriouslyC 4y ago
    SD isn't great at generating images for detailed, weird prompts (at least not compared to DALL-E2). If you're not great at prompt writing or just having bad luck, you can use img2img with a rough sketch of what you want.
    - capitalsigma 4y ago
      Here, a less specific prompt: "Portrait of Joe Biden in the oval office, 4k render" First attempt: https://pasteboard.co/IYo5m6KeaqF4.png https://pasteboard.co/IYo5m6KeaqF4.png OK, I'll grant you that all of the parts of a face are there and reasonably correct (except for the bottomless pits of darkness in his nose and mouth) Second attempt, I end up with these weird artifacts in his head half of the time (3/5 of my generated images) * https://pasteboard.co/xDFv9KD7Or4U.png https://pasteboard.co/xDFv9KD7Or4U.png * https://pasteboard.co/j7PqHPgorZ9G.png https://pasteboard.co/j7PqHPgorZ9G.png Am I holding it wrong somehow?
      - filoleg 4y ago
        What is your guidance scale number, the number of iterations, and the chosen sampler? Those would be very relevant to know. Pretty much the most relevant thing aside from the prompt itself. Setting guidance scale number higher typically results in imagery getting trippier and more surreal with more artifacts. So i feel like that's the main culprit for the artifacts. I am pretty curious to see how far we can get with this prompt. So I will try playing with it later today and post the results and what I found in a reply to this comment.
        capitalsigma 4y ago
        I'm using the default settings on the webui, here are the parameters: ``` Portrait of Joe Biden in the oval office, 4k render seed:1331361607 width:512 height:512 steps:50 cfg_scale:7.5 sampler:k_lms ```
- bambax 4y ago
  Dall-e is kind of sad. It reminds me of Google Video, that thing before YT.
skybrian 4y ago
Casual users don't have a workflow to hook into, though. A website will be more convenient for them since there's nothing to install, and the web app probably runs faster than whatever hardware they're using.
nextaccountic 4y ago
I wish the same happened with GPT-3

filoleg 4y ago

Yeah, until Stable Diffusion became available, I felt that Dall-E 2 stance on not opening it up was sorta reasonable. Mostly because "groundbreaking tech producing all these impressive results that cost a ton to build, and I bet stable diffusion announcements were all just riding the hype, and it will disappoint at the end." I have never eaten my words as fast as I did when stable diffusion had finally released. Such a gamechanger while running locally, it isn't even funny. All these parameters and samplers one could play with, use a one-click simple gui or cli or a web front-end or even hook it up to any existing code flow that you have going. And it all just works well, with every week bringing new advancements (like img2img). I haven't heard anyone talk about Dall-E 2 in over a month. Like, at all. All while stable diffusion overtook pretty much every single social circle related to image generation that I was in. Major props to the stable diffusion team. They had a very high bar to reach, and not only they managed to do it extremely fast, they blew way past it. Leading by example, in the face of all the "no no no, we gotta keep the model and everything closed, and you shouldnt be able to run it locally, oh and also we hardcoded input filters because safety and we know better than you do" bs arguments was extremely satisfying to watch.

capitalsigma 4y ago
My stable diffusion output looks awful. I've been trying to recreate the xkcd about Joe Biden eating sandwiches, so I try something like "Joe Biden eating a sandwich in the oval office, 4k render, photograph" and I get nightmare fuel with pieces of bread attached to his head, faces that dissolve into random geometric shapes, toppings that melt into hands while a sandwich sits on a plate in front of him, etc. I had high hopes based on posts from the SD subreddit, and I figured Biden would be well represented in the training data. Am I missing something?
- dickholesalad 4y ago
  You might try using image to image with the comic and previously mentioned prompt as inputs.
- CuriouslyC 4y ago
  SD isn't great at generating images for detailed, weird prompts (at least not compared to DALL-E2). If you're not great at prompt writing or just having bad luck, you can use img2img with a rough sketch of what you want.
  - capitalsigma 4y ago
    Here, a less specific prompt: "Portrait of Joe Biden in the oval office, 4k render" First attempt: https://pasteboard.co/IYo5m6KeaqF4.png https://pasteboard.co/IYo5m6KeaqF4.png OK, I'll grant you that all of the parts of a face are there and reasonably correct (except for the bottomless pits of darkness in his nose and mouth) Second attempt, I end up with these weird artifacts in his head half of the time (3/5 of my generated images) * https://pasteboard.co/xDFv9KD7Or4U.png https://pasteboard.co/xDFv9KD7Or4U.png * https://pasteboard.co/j7PqHPgorZ9G.png https://pasteboard.co/j7PqHPgorZ9G.png Am I holding it wrong somehow?
    - filoleg 4y ago
      What is your guidance scale number, the number of iterations, and the chosen sampler? Those would be very relevant to know. Pretty much the most relevant thing aside from the prompt itself. Setting guidance scale number higher typically results in imagery getting trippier and more surreal with more artifacts. So i feel like that's the main culprit for the artifacts. I am pretty curious to see how far we can get with this prompt. So I will try playing with it later today and post the results and what I found in a reply to this comment.
      - capitalsigma 4y ago
        I'm using the default settings on the webui, here are the parameters: ``` Portrait of Joe Biden in the oval office, 4k render seed:1331361607 width:512 height:512 steps:50 cfg_scale:7.5 sampler:k_lms ```
bambax 4y ago
Dall-e is kind of sad. It reminds me of Google Video, that thing before YT.

skybrian 4y ago

Casual users don't have a workflow to hook into, though. A website will be more convenient for them since there's nothing to install, and the web app probably runs faster than whatever hardware they're using.

nextaccountic 4y ago

I wish the same happened with GPT-3