3 ms·

It hasn't got anything to do with the keywords actual meaning really... all of this is just to map the 7000-dimensional internal description space in SD to some

It hasn't got anything to do with the keywords actual meaning really... all of this is just to map the 7000-dimensional internal description space in SD to something we meagre humans can input and output. You can leave it free, but then you have to accept the result can be anything. Normally you do want to leverage some control of the process. The keyword "4k" doesn't "mean" anything to the model, it maps to the internal space through the language model depending on its training on captions earlier. You could just as well have used any other way of assigning some parts of this 7000-dimensional vector, it just turns out these keywords are usable shortcut, just like specifying a camera model or an artist name in essence acts as a "macro" to the internal space.

bjt2n3904 4y ago
Right right. It just seems like a way that could evolve language in a dystopian way. If 4k doesn't really "mean" anything to the algorithm, will it still have meaning for us? Or will our usage of the word start to reflect how the algorithm interprets it? Just like YouTube face. It starts out as us influencing the algorithms, it ends with the algorithms influencing us.
- mgraczyk 4y ago
  I wouldn't worry about it. You could try asking a random person in a bar what they think "4k" means, I'd bet a decent portion of people would say something along the lines of "high quality", and very few would give you the precise pixel count.
  - teaearlgraycold 4y ago
    4k doesn’t have a precise pixel count. If you’re bringing precision into the picture then the reality is 4k is a family of resolutions around 4000 pixels wide. UHD has a precise defined size.
    - astrange 4y ago
      It doesn’t have a precise meaning to this model though - because everything it trained on was downscaled anyway, and because an image on the internet with “UHD” in the caption wasn’t necessarily UHD.
- spywaregorilla 4y ago
  No, because these style prompts are just dumb interfaces to a model. They're very stupid and we will not be using them like this in the (likely near) future. There are many other ways one could query a model for stylistic modifications.
  - l33tman 4y ago
    Yeah there is already textual inversion and other ways to "prompt" the models coming up. I do think pure human-level text will stay (and evolve) as a way though. Stability AI already released an updated CLIP model (the language model used in many of these) for example, also the model in the current SD was intentionally made simple so the whole system could fit in consumer GPUs VRAM, it was not state of the art. There might be some interesting statistical analyses possible at the end of the day btw, like trying to figure out how many commonly widespread "artistic styles" there are in the world's total of art and photography so far. After all that is what a lot of the prompt engineering is about. Sort of a principal component analysis of the dominant 100 styles or something...
bitwize 4y ago
I'm reminded of the hackernews who said that their 3-year-old daughter used "don't forget to like and subscribe!" as a form of goodbye e.g., when relatives left the house.

bjt2n3904 4y ago

Right right. It just seems like a way that could evolve language in a dystopian way. If 4k doesn't really "mean" anything to the algorithm, will it still have meaning for us? Or will our usage of the word start to reflect how the algorithm interprets it? Just like YouTube face. It starts out as us influencing the algorithms, it ends with the algorithms influencing us.

mgraczyk 4y ago
I wouldn't worry about it. You could try asking a random person in a bar what they think "4k" means, I'd bet a decent portion of people would say something along the lines of "high quality", and very few would give you the precise pixel count.
- teaearlgraycold 4y ago
  4k doesn’t have a precise pixel count. If you’re bringing precision into the picture then the reality is 4k is a family of resolutions around 4000 pixels wide. UHD has a precise defined size.
  - astrange 4y ago
    It doesn’t have a precise meaning to this model though - because everything it trained on was downscaled anyway, and because an image on the internet with “UHD” in the caption wasn’t necessarily UHD.
spywaregorilla 4y ago
No, because these style prompts are just dumb interfaces to a model. They're very stupid and we will not be using them like this in the (likely near) future. There are many other ways one could query a model for stylistic modifications.
- l33tman 4y ago
  Yeah there is already textual inversion and other ways to "prompt" the models coming up. I do think pure human-level text will stay (and evolve) as a way though. Stability AI already released an updated CLIP model (the language model used in many of these) for example, also the model in the current SD was intentionally made simple so the whole system could fit in consumer GPUs VRAM, it was not state of the art. There might be some interesting statistical analyses possible at the end of the day btw, like trying to figure out how many commonly widespread "artistic styles" there are in the world's total of art and photography so far. After all that is what a lot of the prompt engineering is about. Sort of a principal component analysis of the dominant 100 styles or something...

bitwize 4y ago

I'm reminded of the hackernews who said that their 3-year-old daughter used "don't forget to like and subscribe!" as a form of goodbye e.g., when relatives left the house.