4 ms·

> is trained on hundreds of millions of images and their associated captions So how do you get access to hundreds of millions of images and use them to create

> is trained on hundreds of millions of images and their associated captions So how do you get access to hundreds of millions of images and use them to create derivative works? Did they get consent from millions of authors? Or is something like that only available to the rich with access to lawyers on tap? I mean I can imagine if a nobody wanted to do something like this, they'd get bankrupted by having to deal with all the photographers / artists spotting a tiny sliver of their art in the image produced by the model. Furthermore, would something like this work with music? For instance, train the model on all Spotify songs and then generate songs based on "Get me a Bach symphony played on sticks with someone rapping like Dr Dre with lisp." Or do music industry have enough money to bully anyone into not doing that?

SleekEagle 4y ago
Presumably Google's terms of service or fair use laws. The real restriction is that, even if you had the dataset, training costs tens of thousands of dollars. Only corporations can really afford to train these things. Regarding music - audio generation with Diffusion Models (the main component of Imagen and DALL-E 2) has been done, but not sure about music specifically. We will definitely reach the point where most e.g. pop beats will be able to be made by AI relatively soon. All a producer has to do is generate 100 beats and select the one s/he likes, potentially interpolate between 2 or finetune it.
davikr 4y ago
I've seen an image generated by AI contain an "Alamy" watermark before.
astrange 4y ago
This is a real issue, but it's solvable with work. It's claimed that ML models' output isn't copyrightable because it's fair use, but that's hard to believe; a large model can easily memorise and output exactly one of its inputs again. This is easier to see with text, where GPT and Copilot both do it, but images can do it too. > So how do you get access to hundreds of millions of images and use them to create derivative works? Did they get consent from millions of authors? Build the model out of Creative Commons images only. There's a lot of 'em and it's good enough. You may need to exclude CC-BY since they currently can't follow the attribution requirement. > Or is something like that only available to the rich with access to lawyers on tap? More likely companies willing to license a stock photography database.
sumy23 4y ago
There are open datasets with that many image-text pairs. E.g. https://laion.ai/blog/laion-400-open-dataset/ https://laion.ai/blog/laion-400-open-dataset/ There is even a dataset with 5 billion image-text pairs if you're feeling adventurous: https://laion.ai/blog/laion-5b/ https://laion.ai/blog/laion-5b/
- varispeed 4y ago
  I didn't know about this! Thank you

SleekEagle 4y ago

Presumably Google's terms of service or fair use laws. The real restriction is that, even if you had the dataset, training costs tens of thousands of dollars. Only corporations can really afford to train these things. Regarding music - audio generation with Diffusion Models (the main component of Imagen and DALL-E 2) has been done, but not sure about music specifically. We will definitely reach the point where most e.g. pop beats will be able to be made by AI relatively soon. All a producer has to do is generate 100 beats and select the one s/he likes, potentially interpolate between 2 or finetune it.

davikr 4y ago

I've seen an image generated by AI contain an "Alamy" watermark before.

astrange 4y ago

This is a real issue, but it's solvable with work. It's claimed that ML models' output isn't copyrightable because it's fair use, but that's hard to believe; a large model can easily memorise and output exactly one of its inputs again. This is easier to see with text, where GPT and Copilot both do it, but images can do it too. > So how do you get access to hundreds of millions of images and use them to create derivative works? Did they get consent from millions of authors? Build the model out of Creative Commons images only. There's a lot of 'em and it's good enough. You may need to exclude CC-BY since they currently can't follow the attribution requirement. > Or is something like that only available to the rich with access to lawyers on tap? More likely companies willing to license a stock photography database.

sumy23 4y ago

There are open datasets with that many image-text pairs. E.g. https://laion.ai/blog/laion-400-open-dataset/ https://laion.ai/blog/laion-400-open-dataset/ There is even a dataset with 5 billion image-text pairs if you're feeling adventurous: https://laion.ai/blog/laion-5b/ https://laion.ai/blog/laion-5b/

varispeed 4y ago
I didn't know about this! Thank you