3 ms·
The group used raw HTML code collected by the California nonprofit Common Crawl to locate images around the web and associate them with descriptive text. It doe
by kleiba 4y ago
The group used raw HTML code collected by the California nonprofit Common Crawl to locate images around the web and associate them with descriptive text. It does not use any manual or human curation.
Does the Common Crawl data already take care of the copyright issue? Or else how does the LAION crawler deal with that problem?
I mean, it's not too hard to write an image crawler. Also, scaling it up it a bit of a challenge, but it's a technical one. But the real difficulty is how to deal with all the legal strings attached...
- Borrible 4y agoWell, at least one content producer is pissed about it. Sorry, only in German: https://www.alltageinesfotoproduzenten.de/2023/04/24/laion-e-v-macht-ernst-schadensersatzforderung-an-urheber-fuer-ki-trainingsdaten/ https://www.alltageinesfotoproduzenten.de/2023/04/24/laion-e... And translated via Google translate: https://www-alltageinesfotoproduzenten-de.translate.goog/2023/04/24/laion-e-v-macht-ernst-schadensersatzforderung-an-urheber-fuer-ki-trainingsdaten/?_x_tr_sl=auto&_x_tr_tl=de&_x_tr_hl=de&_x_tr_pto=wapp https://www-alltageinesfotoproduzenten-de.translate.goog/202...
- Silverback_VII 4y agoAfter reading it, it seems that LAION is merely doing the dirty work (going as far as intimidating the creators of the materials they use) so that other companies can utilize copyrighted material without taking too much risk. Not sure if this teacher is a hero...
- nprateem 4y agoIt's not really a difficulty though is it, for VC funded unicorns who ask forgiveness and move fast. When the law catches up, if ever, they'll pay a slap on the wrist while sitting on their superyachts
- layer8 4y agoLAION doesn’t publish the images, only the metadata, which includes the original image URLs. Anyone who wants to make use of the image set has to re-download the images from the original sources [0], and is then liable for actually using the images. Arguably, the alt text contained in the metadata is still subject to copyright though. [0] see also https://news.ycombinator.com/item?id=35681085 https://news.ycombinator.com/item?id=35681085
- XorNot 4y agoThis is the most commonly misunderstood characteristic of LAION, and I find that alarming because it feels like it just plain means a lot of people don't understand how the internet actually works. Which is not surprising but guys, it's everywhere it's also not optional to understand this.
- Silverback_VII 4y agoYet, what LAION is doing appears to be somewhat obvious. We are a non-profit and not publishing the images seems like hiding behind technicalities.
- XorNot 4y agoWhat do you think they're doing?
- dahwolf 4y agoWe understand it just fine. Us internet people do free labor, then others take it and monetize it.
- XorNot 4y agoSeems like you both don't understand LAION and don't understand hyperlinking.
- slow_typist 4y agoArguably, a short alt text does not meet the threshold of originality under most jurisdictions. See https://en.m.wikipedia.org/wiki/Threshold_of_originality https://en.m.wikipedia.org/wiki/Threshold_of_originality
- slow_typist 4y agoAccording to Christoph Schumann there is legislation in Europe that allows the usage of crawled data for public research institutions and nonprofit organisations. LAION is a registered german nonprofit (gemeinnütziger Verein). Source: https://entwickler.de/machine-learning/laion-open-source-ai https://entwickler.de/machine-learning/laion-open-source-ai (found in another post).
- gorbachev 4y agoCommercial entities are using the data, however. I'm pretty sure the German legislation didn't mean that to be allowed.
- slow_typist 4y agoSure. But that is not in LAIONs responsibility. They provide URIs to images and the corresponding alt texts.
- angrais 4y agoLess than 0.01% of the 5.8 billion images have an associated license. This license was taken from the webpage so cannot be trusted.