12 ms·

StyleDrop: Text-to-Image Generation in Any Style

114 points by famouswaffles 3y ago

waffletower 3y ago
Is this another squandered Google AI showcase? To what purpose does another demonstration serve Google when it is not immediately paired with a product announcement, beta access invitation or source code release? Does it merely make it easier for Google researchers to be poached by other AI companies that are actually releasing AI products? Adobe is actually integrating image generation tools directly in its products. What are you waiting for?
- js4ever 3y ago
  I was thinking the same, recent announcements from Google are research papers leading nowhere. At this point as soon as I see something from Google I know it's either a vaporware or a product that will be killed in next 6-18 months.
  - practice9 3y ago
    > announcements from Google are research papers leading nowhere And without code or model files, who knows if research is actually reproducible and not cherry-picked to look good?
    - jumpCastle 3y ago
      Attention is all you need had no code or model and still led somewhere.
      - everlyn 3y ago
        that's not true, "attention is all you need" presents a very complete model that is replicable.
        jumpCastle 3y ago
        In what sense it was more complete or replicable than this paper?
- ipsum2 3y ago
  It's a research paper, not a product. I don't know why you're against this, but I appreciate researchers that publish papers so knowledge isn't siloed in organizations and contribute to the public good and advancement of technology. Please do more of this!
  - waffletower 3y ago
    Straw man, no where did I say that I am against the release of this paper. All I said that was that I don't understand how Google benefits, and I selfishly claimed that more of us could benefit if they created a product. The paper by itself is clearly a gift. I think ultimately it hurts Google to showcase research without product development -- and I also believe the trained model is squandered. If they aren't going to productize it, then they should leak or open source it in a LLaMA fashion. Why the waste? If this was truly a beneficent act somehow despite the weights being locked up in their cloud, where is the carbon footprint data for the training? StabilityAI reports such information for their model releases.
    - elderg 3y ago
      Google doesn't benefit from sharing. Humanity does. It was a beacon for mankind and will continue to be. As for how it can survive on this and how long it can survive on this... well, I guess that's largely depending on how bad sundar drives the company
      - Valgrim 3y ago
        It's not really sharing tough, is it? No source code, no models, no demo... just a couple pages of text, a couple of vague formulas, insufficient to reproduce results (which by the way should be the whole point of research papers). This is not sharing, this is just showing off.
  - raincole 3y ago
    It's a landing page. The other 99.999% of research papers around the world don't have landing pages for a reason.
A6gYPfxNas 3y ago
Super cool, thanks for sharing!
- waffletower 3y ago
  It appears to be fantastic work... work that people can't use.
  - jerrygenser 3y ago
    It seems to be published as research not as a product announcement.
  - allenu 3y ago
    It's confusing that the page's presentation makes it feel like an actual product. The branding of "Style Drop" and the copy makes it feel like something "you" the reader can use right now... and then you can't find a download or sign-up link.
037 3y ago
In the last century, machines replaced craftsmen by doing machine-like work (a handmade nightstand vs an industrial nightstand). Now they will also replace the remaining craftsmen, or the last jobs that only a craftsman could do (just look at the example of icons in the suggested style). But it doesn't matter, soon they will stop doing what we prefer, I guess...
- andybak 3y ago
  Can we maybe keep comments about general "AI and society" to posts about that are actually about that? There's about 10 posts on the front page a day about AI and filling each one up with comments about the broader topic just diffuses the debate - both about the post topic in question and about the important issues you're trying to raise.
  - 037 3y ago
    You're right. For me it was relevant because, for some reason, this is the first time I've experienced this feeling while looking at one of the latest 1000 studies on the subject. However, I must admit that I too am feeling a bit of fatigue when it comes to AI, and I understand the need for specificity.
theaiquestion 3y ago
I feel like people don't understand what this is, and what google has historically done. This is research for some math to improve the ability to do a style transfer, and they show it on their own text-to-image generator muse, which they have also published the structure of. This is what they have typically done, and this is what they didn't do with Bard. No, they did not release waits for it, you cannot run this on your own computer. But they typically didn't release weights for things like Lambda or Imagen either AFAIK. This is not a product. This is not a tool for you to use. This is for researchers. The point of this paper is not to let you run it on your computer. It's to allow other researchers to implement and build on the methods described in the paper.
- LewisVerstappen 3y ago
  Well, it’s clearly not a good strategy since it’s what allowed OpenAI & StabilityAI to get all the credit.
  - saiojd 3y ago
    The researchers want credit for their work. Google wants to stay ahed of their competitors. Google has three moves: 1) Allow publishing everything including source code => this helps the competitor directly. Bad move. 2) Disallow publishing => the researchers will be tempted to switch jobs for their competitor, since staying at Google will hurt their career. Bad move. 3) Allow publishing, but disallow everything else => this helps the competitors a little, but not too much. The researchers get credit for their work, which removes any incentive they have at switching jobs. Seems like the best compromise. At least, that's my speculative take on this. Sure, OpenAI & StabilityAI get the credit in the public's eye, but there are also other incentives at play.
    - nprateem 3y ago
      I think it's pretty obvious MBA case studies will be based on this in future, just as with Kodak inventing but not pursuing digital cameras, Xerox being responsible for the tech behind multiple billion dollar companies they didn't pursue, etc., etc.
kqr 3y ago
Interesting how often "a banana" turned into multiple bananas, and how the coffee machine flip-flops between infusion and grinding, and the towel not only changes number, but also sometimes disappears entirely!
JonathanBeuys 3y ago
The big question is if Google will be able to capitalize on their research. Or if publishing all those papers just plays into the hands of the competition. When I want to try Bard, I still get "Bard isn’t currently supported in your country. Stay tuned!". While me and everyone around me already uses ChatGPT, FastGPT, Phind and Perplexity.
lb7751 3y ago
[dead]
lb7751 3y ago
[dead]

114 points by famouswaffles 3y ago

Is this another squandered Google AI showcase? To what purpose does another demonstration serve Google when it is not immediately paired with a product announcement, beta access invitation or source code release? Does it merely make it easier for Google researchers to be poached by other AI companies that are actually releasing AI products? Adobe is actually integrating image generation tools directly in its products. What are you waiting for?

js4ever 3y ago
I was thinking the same, recent announcements from Google are research papers leading nowhere. At this point as soon as I see something from Google I know it's either a vaporware or a product that will be killed in next 6-18 months.
- practice9 3y ago
  > announcements from Google are research papers leading nowhere And without code or model files, who knows if research is actually reproducible and not cherry-picked to look good?
  - jumpCastle 3y ago
    Attention is all you need had no code or model and still led somewhere.
    - everlyn 3y ago
      that's not true, "attention is all you need" presents a very complete model that is replicable.
      - jumpCastle 3y ago
        In what sense it was more complete or replicable than this paper?
ipsum2 3y ago
It's a research paper, not a product. I don't know why you're against this, but I appreciate researchers that publish papers so knowledge isn't siloed in organizations and contribute to the public good and advancement of technology. Please do more of this!
- waffletower 3y ago
  Straw man, no where did I say that I am against the release of this paper. All I said that was that I don't understand how Google benefits, and I selfishly claimed that more of us could benefit if they created a product. The paper by itself is clearly a gift. I think ultimately it hurts Google to showcase research without product development -- and I also believe the trained model is squandered. If they aren't going to productize it, then they should leak or open source it in a LLaMA fashion. Why the waste? If this was truly a beneficent act somehow despite the weights being locked up in their cloud, where is the carbon footprint data for the training? StabilityAI reports such information for their model releases.
  - elderg 3y ago
    Google doesn't benefit from sharing. Humanity does. It was a beacon for mankind and will continue to be. As for how it can survive on this and how long it can survive on this... well, I guess that's largely depending on how bad sundar drives the company
    - Valgrim 3y ago
      It's not really sharing tough, is it? No source code, no models, no demo... just a couple pages of text, a couple of vague formulas, insufficient to reproduce results (which by the way should be the whole point of research papers). This is not sharing, this is just showing off.
- raincole 3y ago
  It's a landing page. The other 99.999% of research papers around the world don't have landing pages for a reason.

A6gYPfxNas 3y ago

Super cool, thanks for sharing!

waffletower 3y ago
It appears to be fantastic work... work that people can't use.
- jerrygenser 3y ago
  It seems to be published as research not as a product announcement.
- allenu 3y ago
  It's confusing that the page's presentation makes it feel like an actual product. The branding of "Style Drop" and the copy makes it feel like something "you" the reader can use right now... and then you can't find a download or sign-up link.

037 3y ago

In the last century, machines replaced craftsmen by doing machine-like work (a handmade nightstand vs an industrial nightstand). Now they will also replace the remaining craftsmen, or the last jobs that only a craftsman could do (just look at the example of icons in the suggested style). But it doesn't matter, soon they will stop doing what we prefer, I guess...

andybak 3y ago
Can we maybe keep comments about general "AI and society" to posts about that are actually about that? There's about 10 posts on the front page a day about AI and filling each one up with comments about the broader topic just diffuses the debate - both about the post topic in question and about the important issues you're trying to raise.
- 037 3y ago
  You're right. For me it was relevant because, for some reason, this is the first time I've experienced this feeling while looking at one of the latest 1000 studies on the subject. However, I must admit that I too am feeling a bit of fatigue when it comes to AI, and I understand the need for specificity.

theaiquestion 3y ago

I feel like people don't understand what this is, and what google has historically done. This is research for some math to improve the ability to do a style transfer, and they show it on their own text-to-image generator muse, which they have also published the structure of. This is what they have typically done, and this is what they didn't do with Bard. No, they did not release waits for it, you cannot run this on your own computer. But they typically didn't release weights for things like Lambda or Imagen either AFAIK. This is not a product. This is not a tool for you to use. This is for researchers. The point of this paper is not to let you run it on your computer. It's to allow other researchers to implement and build on the methods described in the paper.

LewisVerstappen 3y ago
Well, it’s clearly not a good strategy since it’s what allowed OpenAI & StabilityAI to get all the credit.
- saiojd 3y ago
  The researchers want credit for their work. Google wants to stay ahed of their competitors. Google has three moves: 1) Allow publishing everything including source code => this helps the competitor directly. Bad move. 2) Disallow publishing => the researchers will be tempted to switch jobs for their competitor, since staying at Google will hurt their career. Bad move. 3) Allow publishing, but disallow everything else => this helps the competitors a little, but not too much. The researchers get credit for their work, which removes any incentive they have at switching jobs. Seems like the best compromise. At least, that's my speculative take on this. Sure, OpenAI & StabilityAI get the credit in the public's eye, but there are also other incentives at play.
  - nprateem 3y ago
    I think it's pretty obvious MBA case studies will be based on this in future, just as with Kodak inventing but not pursuing digital cameras, Xerox being responsible for the tech behind multiple billion dollar companies they didn't pursue, etc., etc.

kqr 3y ago

Interesting how often "a banana" turned into multiple bananas, and how the coffee machine flip-flops between infusion and grinding, and the towel not only changes number, but also sometimes disappears entirely!

JonathanBeuys 3y ago

The big question is if Google will be able to capitalize on their research. Or if publishing all those papers just plays into the hands of the competition. When I want to try Bard, I still get "Bard isn’t currently supported in your country. Stay tuned!". While me and everyone around me already uses ChatGPT, FastGPT, Phind and Perplexity.

lb7751 3y ago

[dead]

lb7751 3y ago

[dead]