17 ms·
Search 5.8B images used to train popular AI art models
- deleted 4y ago[deleted]
- homarp 4y agotweet explaining: https://twitter.com/matdryhurst/status/1570143343157575680 https://twitter.com/matdryhurst/status/1570143343157575680 " Releasing our first Spawning tool to help artists see if they are present in popular AI Art training data, and register to use our tools to opt in and opt out of AI training I think we have created a way to make this work out well for everyone" and StableDiffusion's Emad Mostaque agreeing to support the initiative https://twitter.com/EMostaque/status/1570158985852121090 https://twitter.com/EMostaque/status/1570158985852121090
- latchkey 4y agoI just uploaded a picture of my dog (Bichon Frise) and it showed me a bazillion nearly exact similar dogs. Why isn't this immediately being used as a missing persons (or pet) database service?
- at_a_remove 4y agoLet's think of reasons! 1) Privacy. 2) Lack of geolocation data associated. 3) Privacy. 4) Lack of contact information attached. 5) Privacy. 6) Lack of case numbers for various missing persons cases being attached. 7) Privacy.
- latchkey 4y agoCertainly this could be used for evil (tm), but it seems like something could also be built out that enables this for good in ways that don't cause issues with Mr. Fibbonaci.
- groby_b 4y agoBecause you're missing a person, not a picture of them?
- philipkglass 4y agoI think that you answered your own question. You uploaded a picture of your non-missing dog and it found many very similar looking dogs.
- fimdomeio 4y agosometimes people are missing, sometimes they just have legitimate reasons to not want to be found.
- visarga 4y agoRe-identification is harder than just ranking by similarity.
- 0xrisk 4y agoI'm one of the people building this. Hi HN, AMA :)
- telotortium 4y agoWhat visual search engine are you using?
- simandl 4y agoThis is clip matching the text or image searched to the images in the Laion-5B dataset.
- tener 4y agoPrivacy policy for searched strings? "Rutkowski" returns a bunch of book covers, repeated a lot. Can you ensure images returned have diverse embeddings? I expected digital art, not detective stories. Do you use CLIP or just metadata? What is intended process that starts after you get artist's email (for either of purposes).
- simandl 4y agoIt's using clip to match the text to the image, so you can actually prompt it like you might an art generator. Here's "in the style of greg rutkowski": https://haveibeentrained.com/?search_text=in%20the%20style%20of%20greg%20rutkowski https://haveibeentrained.com/?search_text=in%20the%20style%2... In the next few weeks we'll be adding the ability to log in and flag or upload your works (if they aren't there). Those lists will have permissions assigned to them, starting with simple opt-in or opt-out.
- freefruit 4y agoHow do you have the rights to use any of the images? They are clearly the same as what a Google image search would result in. However google links to the source.
- simandl 4y ago
- prox 4y agoIt surprises me how many meme images there are. Aren’t they low quality content? I haven’t tried but I don’t see SD making any memes by themselves yet.
- simandl 4y agoStable Diffusion used an aesthetic filter to train on a subset of the English language images from this full 5.8 billion multi-language set. That probably got a lot of what you're finding.
- gigel82 4y agoIt's surprising how poorly labeled these images are; who is curating this collection? Can't they crowd-source a proper labeling project - I wonder how much better things like Stable Diffusion would be if its training would include correct, complete labels for the images. I'm sure lots of folks would willingly spend a few minutes here and there to aid with the labeling if it means they get to enjoy the model for free.
- simandl 4y agoThis is Laion-5B, you can read more about it here: https://laion.ai/blog/laion-5b/ https://laion.ai/blog/laion-5b/ Imagen and Stable-Diffusion both used subsets of this full 5.8B image set.
- yreg 4y agoIs Imagen actually trained on a subset of Laion-5B and nothing else? I've heard they used huge internal data sets.
- simandl 4y agoThey have their own datasets and included Laion-400M, a subset of 5b that was released prior to 5b. You can see a short explanation in imagen's "Limitations and Societal Impact" section at: https://imagen.research.google/ https://imagen.research.google/. > While a subset of our training data was filtered to removed noise and undesirable content, such as pornographic imagery and toxic language, we also utilized LAION-400M dataset which is known to contain a wide range of inappropriate content including pornographic imagery, racist slurs, and harmful social stereotypes.
- orbital-decay 4y agoIf you aren't Google, manually doing that with 5+ billion images might prove difficult, to put it mildly. Large-scale labeling is typically bootstrapped with smaller models and whatever manual data you have. What's being curated is the bootstrapping process.
- mgraczyk 4y agoHalf page popup cookie banner with no opt-out option. I am completely fine with cookies but clearly there is something wrong with the state of things when I have to click through a completely non-actionable popup
- constantlm 4y agoI'd love to know how this works. I entered my own name for the lols, and it returned mostly paintings of the Cape Winelands in South Africa where I grew up, which is pretty creepy.
- 0xrisk 4y agothat is crazy. Perhaps your family name is common in that region?
- simandl 4y agoIt's using openai's clip (https://openai.com/blog/clip/ https://openai.com/blog/clip/) to find the image similar to your query or image. Clip learned to match images to the captions that were paired with them from images on the web. My best guess would be that there were enough pictures from someone with your name (maybe just last name) that it made that association.
- quantified 4y agoI entered mine and it returns a ton of 1800's images of men (apt) with a similar first name and rather different last names. It has a long way to go on this front.
- gauravphoenix 4y agointerestingly, if you search for "127.0.0.1", it throws {"message":"Forbidden"} in the api response and the page says- Sorry, there was an error with your search. Please try a different request.
- jonas-w 4y agoSame for "localhost" but "[::1]" works.
- naet 4y agoI put in Donald Trump to see what kind of celebrity images might be in there, and there are a TON of memes / photoshopped versions of him looking like a caricature or otherwise warped. I wonder if the AI will average these into a fair resemblance, or whether prompts using his name will end up more cartoonish than other names due to the source data...
- version_five 4y agoI found this very similar to what you'd get with a google / bing / etc image search. Is that where this database comes from? I noticed there is a lot of "Shutterstock" watermarked stuff. And I also checked a few "adult" terms (large breasts etc) and found there is a lot of nude content. Only curious because I've seen lots of the generative models have some post-filtering for nudity, why don't they just clean it out of the training data if they're worried?
- simandl 4y agoThis is Laion-5B, https://laion.ai/blog/laion-5b/ https://laion.ai/blog/laion-5b/ It's built off of common crawl, so it probably does have a pretty representative sample from whatever the big image searches use. Funny enough, the NSFW filter that laion built is turned on. Without it, it's... a lot. The NSFW stuff is done with a model, so you get a probability of NSFW out of it, and you can select a threshold. If you set the threshold high, like 95% certainty that an image is nsfw to filter it, you get a bunch of false negatives, letting a ton of nsfw through. Set it too low, and you throw out stuff that isn't nsfw. We (haveibeentrained) erred on the side of too high, so we wouldn't tell artists their work wasn't in there if it was. Tough trade-off there. Similar to using the dataset to train an AI model, where you might cut off useful images from training if you try and filter all the nsfw.
- educaysean 4y agoOne thing that sticks out to me is how so much of the the images in the collection have really terrible labels. I uncovered a large collection of pieces by an illustrator who was unsearchable by name, only via image upload. The reason they were unsearchable: the majority of this particular artist's images had labels that were all in the format of: {username}'s profile image
- shantara 4y agoDoes this website search the same dataset as https://knn5.laion.ai https://knn5.laion.ai?
- simandl 4y agoYes, that's the same dataset. This website has some additional tools coming so artists can flag and opt out, or upload to opt in, and we'll get those to the laion team to add or remove from the 5B (and future) datasets.
- Jach 4y agoWhat's your approach to establishing authorship? I'm sure some trolls will try to claim things they didn't actually make and get them removed (and vice versa).
- simandl 4y agoOur initial approach will be to validate the artists manually, and trust them to only flag or upload their own works. If we hit a scale where that starts to become an issue, we have plenty of ideas for mitigating this, but we're not optimizing for that problem yet.
- NicoleJO 4y agoYou have no way to stop people from uploading content that isn't theirs. Worse, you have no way to stop your program from stealing uploaded intellectual property. Once uploaded, it's Stolen!
- hammyhavoc 4y agoWow, so I've been trained. Many times over. Photos stolen from my personal portfolio.
- simandl 4y agoPlease do sign up and you'll be able to flag these images soon. We'll work to get them removed from this and future datasets built for AI training.
- throw_m239339 4y ago"better ask for forgiveness than ask for permission" or something? It can't always work that way.
- hammyhavoc 4y agoSigned up! Very interested in this.
- NicoleJO 4y agoThis person isn't being upfront with you. Your photographs' data has already been assimilated. That's not a joke.
- deleted 4y ago[deleted]
- yunwal 4y agoThis person doesn’t know what they’re talking about, or is withholding information. Yes, your photos have been used to train early iterations of the stable diffusion models. Those iterations are hardly usable in most applications, and will be phased out in A few weeks. If Spawning is able to have your images removed from the training set by version 1.7 or whatever, you will be removed from any models actually in use for real commercial applications.
- NicoleJO 4y ago
- deleted 4y ago[deleted]
- smel 4y agoThere is a lot of porn there
- quantified 4y agoI'll get downvoted massively, but porn is by definition art (meant to be viewed and evoke reactions, just as advertising art is), and has been some of the most important creative outputs for as almost as long as humans have been creating art.
- throw_m239339 4y ago> but porn is by definition art No, that's why it's called pornography, very much to differentiate it from something "noble" like art, it's vulgar and trivial, by the very definition of the word it isn't art.
- quantified 4y agoEtymology is "writing about prostitutes" [https://www.merriam-webster.com/dictionary/pornography https://www.merriam-webster.com/dictionary/pornography]. So you got me there. In the realm of visual depictions, it's just as much art as cave art. Art is a broad classifier. Still lifes are art. Landscapes are art. Audubon's drawings of birds are art. Porn is film, photography and drawing, with a specific subject matter. If Iron Man comics are art, it is too. "Noble" is nowhere in any working definition of art. Some academic snob might use it with their in-crowd. Damien Hirsch's shark parts is considered art.
- throw_m239339 4y ago> Art is a broad classifier. "everything I say is art is art", you basically. Well anything I say isn't art isn't art. Especially pornography in general, which sole purpose is sexual gratification of the audience through sexual exploitation, rape via human trafficking. There is nothing snob is saying that. There something egregious and dehumanizing in saying what you say on the other hand and trying to normalize the very definition of vulgarity.
- ericjang 4y agoIt would be a stunning twist of irony if this website uploaded images to a proprietary image dataset used for training AI models, pitching "uncorrelated data"
- simandl 4y agoWe don't store any images used for searching. We are building an opt-in list, because a lot of people do want to be able to prompt AI with something like, "a cat in the style of me" or "me riding a dinosaur". That will be shared publicly, of course.
- mrweasel 4y agoThat highlights one of my "concerns" about AI training sets. There seems to be a very real risk of accidentally adding an image that you have no rights to, so what happens if someone finds out and demand their image removed from all models trained on that image? You can't really back an image out of a model, you can only retrain without that image. Creative Commons should add a new license that prohibits the use of ones work to train AI.
- ghaff 4y agoBecause Creative Commons really needs another non-open license variant like non-commercial that no one really understands what they allow and don't allow so you're better off just not using them if you're being conservative. </s>
- hahajk 4y agoThis is great just from a prompt engineering perspective. Now I can see what labels are typically like for the types of images I'm looking for instead of guessing.
- simandl 4y agoFor sure! And as artists opt in, you'll be able to use it to see how they describe their work.
- cercatrova 4y agoYou can do that with lexica.art too, nothing special with this particular implementation that OP has.
- yeldarb 4y agoExcited to see semantic search getting legs with this and Lexica[1]. Related: we recently released[2] semantic search for custom datasets. You can use it to find all sorts of weird stuff in benchmark datasets like MS COCO[3] used to train many computer vision models. If folks are interested I can write up a "how we made it" post describing the behind the scenes. [1] https://lexica.art/ https://lexica.art/ [2] https://blog.roboflow.com/dataset-search/ https://blog.roboflow.com/dataset-search/ [3] https://blog.roboflow.com/coco-dataset-image-search/ https://blog.roboflow.com/coco-dataset-image-search/
- NicoleJO 4y agoReadme1st: What’s Really Behind Those AI Art Images? https://newsletters.theatlantic.com/galaxy-brain/6317de90bcbd490021b246bf/ai-art-dalle-midjourney-stable-diffusion/ https://newsletters.theatlantic.com/galaxy-brain/6317de90bcb...
- simandl 4y agoThis article highlights several of the problems that we are working on. Here's another article, about our organization: https://www.inputmag.com/culture/mat-dryhurst-holly-herndon-artists-ai-spawning-source-dall-e-midjourney https://www.inputmag.com/culture/mat-dryhurst-holly-herndon-...
- jumperabg 4y agoThis NSFW! Do not open this while at work my first search was yeah let me check this totally family friendly search term and badabing badabong CTRL + W!
- patates 4y agoYup, apparently there's a fetish for every innocent word you can imagine and this thing is completely unfiltered.
- deleted 4y ago[deleted]
- hadrianpaulo 4y agoHmm, you can really see how biased the datasets are towards certain groups. For example, type in "Filipino" and you get NSFW photos. Filipino is what we call citizens of the Philippines, btw.
- behnamoh 4y agoOn Brave I get "malicious site ahead" warning.
- simandl 4y agoWe think this is because the images are all links and the browser itself is pulling them in from across the web. With chrome it happened once during our testing, and we've had one user also experience it, but it's intermittent. Thank you for pointing to brave, which we haven't tested yet! That might help us repeat the errors.
- BLSstudio 4y agoIt would be great to have some simple text from the artist connected to the artist’s images. Things like, artist’s name, title, subject matter… Many of my images (drawings and paintings) aren’t associated with my name and instead are associated with different drugs and psychology and other things. It would be better to have the opportunity to somehow to enhance that. To influence the future prompt results. I feel like it would make Ai more intelligent.
- simandl 4y agoThank you for the feedback! That's what we're hoping our opt-in tools will help artists do. For the problems you've posed here, you might actually want to both opt-in and opt-out. You'd be able to flag the imageurl-caption pairs that don't accurately credit you or describe your work and we'll forward them to the dataset creators for removal. You could then add any works that you're comfortable being used for AI training, and caption them however you'd like. Those would go into the dataset and be used when training future models. We'd love to have you sign up if you're interested! We expect to start the beta for those tools in 2 to 3 weeks.