3 ms·

Compositional power might mean "the image more resembles the composition you want and describe" i.e. if you say "a red cube on a green sphere" in DeepFloyd, yo

Compositional power might mean "the image more resembles the composition you want and describe" i.e. if you say "a red cube on a green sphere" in DeepFloyd, you will get it. If you say that in MJ, you won't. That means you have more power to compose the image you want with this tool.

Zetobal 3y ago
No, it does mean you don't understand how to prompt MJ, you don't understand it's language. You might like french more but it doesn't mean that it's a better language than english. MJ even says that their model doesn't understand language like humans do in their FAQs...
- dragonwriter 3y ago
  The point of text to image model is for them to accept natural language (yes, in practice, they all benefit from specialized prompting done with an understanding of model quirks, but that’s not the goal.)
  - Zetobal 3y ago
    The way to prompt is a preference like programming languages ofc the layman might use the javascript of generative models because it's easier to start and there are a lot of tutorials but some might prefer something more exoctic which can produce the same or better quality. Whatever floats your boat but don't try to compare it like the guy in OPs tweets. MJ and stable also make clear that their models don't understand language like humans do.
    - ben_w 3y ago
      > MJ and stable also make clear that their models don't understand language like humans do. I believe the claim here is "and we would like them to".
- epivosism 3y ago
  Please give me a prompt which would back up your claim that MJ can do this! I'd love to learn
- epivosism 3y ago
  For example, please help me understand how to help MJ do the prompt above! https://twitter.com/eb_french/status/1651365078137200640 https://twitter.com/eb_french/status/1651365078137200640 BTW I am a HUGE fan of MJ, and attend the office hours, and have done 35k+ images there. So you may have misinterpreted how much of a supporter of it I am.
  - Zetobal 3y ago
    first shot but it's a starting point. With 35k images you should be able to do this yourself. a single (green sphere), with a single (red cube), balancing ((on top)) https://imgur.com/a/QePgM6I https://imgur.com/a/QePgM6I
    - epivosism 3y ago
      Interesting, I do not get the results you do. What additional parameters are you using? Here is a link to some of my tests, with all default settings, some in v5 some in v4. https://twitter.com/eb_french/status/1651370091869786112 https://twitter.com/eb_french/status/1651370091869786112 0/16 images have a red cube on a green sphere.
      - Zetobal 3y ago
        none and as an experienced user you should know that's it's not one shot and most of the time not even few shot... You can't compare cherry picked press images with few shots of a 5 second prompt. I don't know why you want to hype something up if you can't really compare it. It seems extremly attention grifting. Just look at their cherry picks in this discord... https://discord.com/invite/pxewcvSvNx https://discord.com/invite/pxewcvSvNx . It's overfitted on images with copyright (afghan girl) and doesn't show more "compositional power" at all most of the time ignoring half of the prompt.
        dragonwriter 3y ago
        > as an experienced user you should know that's it's not one shot Being "not one shot" for most nontrivial prompts is a failure of current t2i models, its what they all strive for and its what DF supposedly does a lot better. And, while its possible to spin things pretty hard when people can't bang on it themselves, I think the indication is that it is, in fact, a major leap forward from the best current consumer-available t2i models (it looks pretty comparable to Google Imagen – a little bit worse benchmark scores – which is unsurprising since it seems to be an implementation of exactly the architecture described in Google's Imagen paper. > It’s overfitted on images with copyright (afghan girl) It’s…not, though. Sure, the picture with a prompt which is suggestive of that (down to even specifying the same film type) gives off a vibe that completely feels, if you haven’t recently looked at the famous picture but are familiar with it, like a “cleaned up” version of that picture, so you might intuitively feel its from overfitting, that it is basically reproducing the original image with slight variations. Look at the two pictures side-by-side and there is basically nothing similar about them except exactly the things specified in the prompt, and pretty much every aspect of the way that those elements of the prompt is interpreted in the DF image is unlike the other image.

Zetobal 3y ago

No, it does mean you don't understand how to prompt MJ, you don't understand it's language. You might like french more but it doesn't mean that it's a better language than english. MJ even says that their model doesn't understand language like humans do in their FAQs...

dragonwriter 3y ago
The point of text to image model is for them to accept natural language (yes, in practice, they all benefit from specialized prompting done with an understanding of model quirks, but that’s not the goal.)
- Zetobal 3y ago
  The way to prompt is a preference like programming languages ofc the layman might use the javascript of generative models because it's easier to start and there are a lot of tutorials but some might prefer something more exoctic which can produce the same or better quality. Whatever floats your boat but don't try to compare it like the guy in OPs tweets. MJ and stable also make clear that their models don't understand language like humans do.
  - ben_w 3y ago
    > MJ and stable also make clear that their models don't understand language like humans do. I believe the claim here is "and we would like them to".
epivosism 3y ago
Please give me a prompt which would back up your claim that MJ can do this! I'd love to learn
epivosism 3y ago
For example, please help me understand how to help MJ do the prompt above! https://twitter.com/eb_french/status/1651365078137200640 https://twitter.com/eb_french/status/1651365078137200640 BTW I am a HUGE fan of MJ, and attend the office hours, and have done 35k+ images there. So you may have misinterpreted how much of a supporter of it I am.
- Zetobal 3y ago
  first shot but it's a starting point. With 35k images you should be able to do this yourself. a single (green sphere), with a single (red cube), balancing ((on top)) https://imgur.com/a/QePgM6I https://imgur.com/a/QePgM6I
  - epivosism 3y ago
    Interesting, I do not get the results you do. What additional parameters are you using? Here is a link to some of my tests, with all default settings, some in v5 some in v4. https://twitter.com/eb_french/status/1651370091869786112 https://twitter.com/eb_french/status/1651370091869786112 0/16 images have a red cube on a green sphere.
    - Zetobal 3y ago
      none and as an experienced user you should know that's it's not one shot and most of the time not even few shot... You can't compare cherry picked press images with few shots of a 5 second prompt. I don't know why you want to hype something up if you can't really compare it. It seems extremly attention grifting. Just look at their cherry picks in this discord... https://discord.com/invite/pxewcvSvNx https://discord.com/invite/pxewcvSvNx . It's overfitted on images with copyright (afghan girl) and doesn't show more "compositional power" at all most of the time ignoring half of the prompt.
      - dragonwriter 3y ago
        > as an experienced user you should know that's it's not one shot Being "not one shot" for most nontrivial prompts is a failure of current t2i models, its what they all strive for and its what DF supposedly does a lot better. And, while its possible to spin things pretty hard when people can't bang on it themselves, I think the indication is that it is, in fact, a major leap forward from the best current consumer-available t2i models (it looks pretty comparable to Google Imagen – a little bit worse benchmark scores – which is unsurprising since it seems to be an implementation of exactly the architecture described in Google's Imagen paper. > It’s overfitted on images with copyright (afghan girl) It’s…not, though. Sure, the picture with a prompt which is suggestive of that (down to even specifying the same film type) gives off a vibe that completely feels, if you haven’t recently looked at the famous picture but are familiar with it, like a “cleaned up” version of that picture, so you might intuitively feel its from overfitting, that it is basically reproducing the original image with slight variations. Look at the two pictures side-by-side and there is basically nothing similar about them except exactly the things specified in the prompt, and pretty much every aspect of the way that those elements of the prompt is interpreted in the DF image is unlike the other image.