19 ms·
Sarah Silverman is suing OpenAI and Meta for copyright infringement
- seydor 3y ago[flagged]
- smitty1e 3y agoThis promises to be an interesting wrinkle in the history of "Fair Use" law. Art has some amount of originality/distinctive quality. One surmises that AI is going to need to inject some entropy to avoid crossing a vague "Fair Use" line, for a useless internet lawyer opinion.
- jeffgreco 3y agoI mean I’m no lawyer but this doesn’t strike me as a great example for infringement? Detailed summaries of books sounds like textbook transformative use. Especially in Silverman’s case, reducing her book to “facts” while eliminating artistic elements of her prose make it that much less of a direct substitute for the original work.
- citizenkeen 3y agoHaven't read the complaint, but there might be an argument that OpenAI used stolen works to train their data, and as such fair use doesn't apply.
- georgeoliver 3y agoPerhaps not, I thought one of the claims is interesting though, that they illegally acquired some of the dataset. What would be the damages from that, the retail price of the hardcopy?
- getmeinrn 3y agoWouldn't they first need to prove that OpenAI didn't ingest summaries of the book, and not the book itself?
- deleted 3y ago[deleted]
- Jolter 3y agoI think this can to some extent be determined in the discovery phase of the lawsuit. We probably could have some interesting outputs from this process.
- banana_feather 3y agoThe remedies under Title 17 are an injunction against further distribution, disgorgement or statutory damages, and potentially attorneys fees. The injunction part is why these cases usually settle if the defendant is actually in the wrong.
- dclowd9901 3y agoCould a suitably prompted LLM repeat, verbatim, the book in its entirety?
- jeffgreco 3y agoPerhaps? But certainly not what’s shown here.
- jrm4 3y agoThe more I think about it, I think it will (and should) turn on the extent to which "the law" considers the AI's to be more like "people" or more like "machines?" People can read and do research and then spit out something different. But "feeding the data into a machine" seems like obvious infringement, even if the thing that comes out on the other end isn't exactly the same?
- binarymax 3y agoI can see a good argument in the complaint. The provenance of the training data leads back to it being acquired illegally. Illegally acquired materials were then used in a commercial venture. That the venture was an AI model is perhaps beside the point. You can’t use illegally acquired materials when doing business.
- refulgentis 3y agoIt seems like a weak argument, in that it is just as likely it saw any number of things about it, from book reviews to sales listings to interviews.
- bugglebeetle 3y agoUnless OpenAI can prove that the outputs are derived from legally vs illegally-obtained outputs, not sure that’s going to matter. And as far as I understand about their models, that’s effectively impossible.
- kevinventullo 3y agoIsn’t the burden of proof on the other side?
- bugglebeetle 3y agoNot when OpenAI publicly declared they trained on pirated works. I can’t imagine “we can’t tell if this is the result of the illegal thing we did or not” is going to stand up very well, nor does it bode well for any refutation of the plaintiff’s depiction of their intent. Part of fair use consideration is commercial impact and when you steal a bunch of books to train your AI model, it’s hard to refute that the impact is not negative or that you didn’t intend commercial harm.
- pama 3y agoPlease read more carefully. OpenAI never “declared they trained on pirated works.”
- koheripbal 3y agoHer arguments make no sense.
- crazygringo 3y agoThis is actually quite interesting, as it's drawing a distinction between training material that can be accessed by anybody with a web browser (like anybody's blog), vs. training material that was "illegally-acquired... available in bulk via torrent systems." I don't think there's any reason why this would be a relevant legal distinction in terms of distributing an LLM -- blog authors weren't giving consent either. However, I do wonder if there's a legal issue here in using pirated torrents for training. Is there any legal basis for saying fair use permits distributing an LLM trained on copyrighted material, but you have to purchase all the content first to do so legally if it's only available for sale? E.g. training on a blog post is fine because it's freely accessible, but Sarah Silverman's book is not because it's never been made available for free, and you didn't pay for it? Or do the courts not really care at all how something is made? If you quote a passage from a book in a freelance article you write, nobody ever asks if you purchased the book or can prove you borrowed it from a library or a friend -- versus if you pirated a digital copy.
- akira2501 3y agoI'm allowed to make private copies of copywritten works. I'm not allowed to redistribute them. To what extent this is redistribution is not clear. Is there much of difference between this model and a machine, like a VCR, that recreates the original work when I press a button?
- seanmcdirmid 3y agoThis would be like you intensely studying the copy written work and then writing things based on the knowledge you obtained from that. Except, we don't know if their is an exception for things learned by people vs. things learned by machines, or if the machines are not really learning but copying instead (or if learning is intrinsically a form of copying?).
- pbhjpbhj 3y agoIn the case of unreleased work, you writing about your knowledge of it is just proof that you obtained the work, which is proof that you committed a tort/trespass. Just like if you published a newspaper article with information you could only have acquired by hacking someone's phone. I'm not sure what a court would find against you, but it seems clear that there would be some way to couch that as a legal grievance.
- xyzal 3y agoI wonder if the makers of AI may have some index of learning material to perhaps prove they did not infringe? Or they just throw everything they get their hands on to the LLM?
- qayxc 3y agoIt's the latter. The current approach is akin to throwing the entire internet at the foundational model, train it for an epoch or two, and that's that. Afterwards, the finetuning with curated training material, and techniques like RLHF (Reinforcement Learning from Human Feedback) takes place. The sources of the training material are... questionable, to say the least. There's a reason the training dataset for GPT 3.5 and 4 remains undisclosed.
- gfaure 3y agoI severely doubt that the spiders which crawled the data would go to the trouble of dereferencing and downloading torrents.
- msp26 3y agoIt was probably just pdf copies of the book from random a random ddl website.
- pessimizer 3y ago> The complaint lays out in steps why the plaintiffs believe the datasets have illicit origins — in a Meta paper detailing LLaMA, the company points to sources for its training datasets, one of which is called ThePile, which was assembled by a company called EleutherAI. ThePile, the complaint points out, was described in an EleutherAI paper as being put together from “a copy of the contents of the Bibliotik private tracker.” Bibliotik and the other “shadow libraries” listed, says the lawsuit, are “flagrantly illegal.”
- getmeinrn 3y agoA more convincing exhibit would have been convincing ChatGPT to output some of the text verbatim, instead of a summary. Here's what I got when I tried: I'm sorry for the inconvenience, but as of my knowledge cutoff in September 2021, I don't have access to specific external databases, books, or the ability to pull in new information after that date. This means that I can't provide a verbatim quote from Sarah Silverman's book "The Bedwetter" or any other specific text. However, I can generate text based on my training and knowledge up to that point, so feel free to ask me questions about Sarah Silverman or topics related to her work!
- shultays 3y agoI tried making chatgpt output first paragpraph of lord of the rings before, it goes silent after first few words. Looks like the devs are filtering it out
- simion314 3y agoMaybe you missed this discussion https://news.ycombinator.com/item?id=36400053 https://news.ycombinator.com/item?id=36400053 it seems OpenAI is aware of their software outputs copyrighted stuff so they attempted some quick fix filter. So the fact it will not ouput the book for us when we ask does not prove that the AI does not have memorized big chunks of it, it might just be some "safety" filter involved and you need soem simple trick to get around it.
- Jolter 3y agoGPT is a lossy jpeg of the whole Internet. It’s not possible to extract verbatim text from it, due to how neural networks work. How do you think they would fit exabytes of text data into a gigabyte-sized neural network? That’s right, it’s lossy.
- getmeinrn 3y ago>It’s not possible to extract verbatim text from it I didn't ask for the whole book, I asked for the first paragraph. It absolutely is possible to get verbatim text from chatgpt.
- throwuwu 3y agoIsn’t it much more likely that there are a lot of book reviews and summaries in its training set from which it can synthesize its own?
- VWWHFSfQ 3y agoI think it's actually much more likely that they just dumped a bunch of book PDFs in the training folder and let it go to work. I seriously doubt any of these AI companies are being even the least bit careful about the data they're lapping up for training
- throwuwu 3y agoTraining data quality is hugely important so I very much doubt they don’t curate the text they use.
- sureglymop 3y agoWhere are the summaries from? I would say it's much more likely that a shadow library was scraped but if course that is also seemingly impossible to prove. One may be able to somewhat test that by asking for a summary of a book/text only available on a shadow library.
- pbhjpbhj 3y agoYou could ingest all reviews that are extent in the online corpus, remove from the book all quotes found. Then ask the AI if a distinctive triples, say, of words appeared in their book, somehow, you'd probably need prompt engineering to get past "While I don't have access to the full text of the book [...]". A little maths and you might prove beyond reasonable doubt that the LLM was trained on the book. As a step towards a PoC I looked at https://www.amazon.co.uk/Bedwetter-Stories-Courage-Redemption-Pee-ebook/dp/B0045I7FYW https://www.amazon.co.uk/Bedwetter-Stories-Courage-Redemptio... and found a reference to "Boys' Market Manchester" which seemed like a Googlewhack-ish (unlikely) triple of words. Then I asked ChatGPT about it: Me: Has Sarah Silverman ever written about Boys' Market Manchester ChatGPT ChatGPT: As of my knowledge cutoff in September 2021, I do not have any information indicating that Sarah Silverman has written specifically about Boys' Market Manchester. Sarah Silverman is an American comedian, actress, and writer known for her stand-up comedy and her work in film and television. While she has written books and has often shared personal anecdotes in her comedy, I couldn't find any specific references to Boys' Market Manchester in relation to her work. However, please note that my information might not be up to date, as Sarah Silverman's career and activities may have evolved since then.
- ur-whale 3y ago[flagged]
- joiqj 3y ago[flagged]
- homero 3y agoShe'd have to sue every student that writes an essay on a book they'd read
- mgerdts 3y ago... on a book that they’d illegally acquired then read.
- pessimizer 3y ago> The complaint lays out in steps why the plaintiffs believe the datasets have illicit origins — in a Meta paper detailing LLaMA, the company points to sources for its training datasets, one of which is called ThePile, which was assembled by a company called EleutherAI. ThePile, the complaint points out, was described in an EleutherAI paper as being put together from “a copy of the contents of the Bibliotik private tracker.” Bibliotik and the other “shadow libraries” listed, says the lawsuit, are “flagrantly illegal.”
- lyu07282 3y agoBut don't you see what a strange argument that is? It doesn't matter, the student did nothing wrong, I don't want to live on a planet where we put DRM into peoples brains (or AI for that matter) to enforce this absurd and overreaching idea of intellectual property. And besides the publishers extorting thousands from young students forced to buy their overpriced mediocre textbooks, warrants any copyright infringement of any book anytime and forever at any scale. Publishers have lost all moral legitimacy in their copyright claims in my book. Copyright is not magic, it's a social contract at the end of the day and they have broken it first.
- mgerdts 3y agoIf the book was acquired illegally, the entity that suffered the loss may have a claim for the illegal acquisition. Meta and OpenAI have the money to buy a copy of every book under copyright that they have their AI read for training. I have more sympathy for losses suffered by a living person that produced creative works than I do for textbook mills. I also have sympathy for open source software authors that applied their creativity to create source code that is spit out verbatim by Copilot without adhering to license terms. I see that Thomas’ Calculus is up to the 14th edition, priced at about 20x the hourly wage that a college student will earn. Thomas and Finney Calculus editions 6 - 8 are on shelves or in boxes somewhere in my house. Each of those cost me or my wife about 20x the student hourly wage back in the day. I bet calculus hasn’t changed a lot in the past 30 years to justify all of these editions. I blame universities for allowing this industry to thrive.
- rkagerer 3y agoI wish these cases were stronger than "it summarizes my books".
- xbar 3y agoI am very glad they are not.
- dragonwriter 3y agoThey are. They are “The creators openly claim that they copied a corpus that includes an unlicensed copy of my book”.
- ravenstine 3y agoCopyright law may eventually destroy business models founded upon AI. Maybe piracy will prevail in correcting the system as it did with entertainment before media companies accepted streaming.
- NoZebra120vClip 3y ago> Copyright law may eventually destroy business models founded upon AI. I think you have that backwards. Mark my words.
- em3rgent0rdr 3y agoIntellectual property in the way of progress, again.
- qayxc 3y agoIn this case I don't think it is. There are legal questions that simply have to be asked and discussed before proceeding mass adoption of generative models. Lawsuits like this are tests to evaluate the current state of affairs and to force legislation into dealing with the greater issue of AI in context of copyright, IP, and fair use. It would only be "in the way" if it would actually stop or hinder anything, which a lawsuit on its own isn't.
- 23B1 3y agoProgress for whom?
- em3rgent0rdr 3y agoSociety. Regular people.
- 23B1 3y agoHow so?
- em3rgent0rdr 3y agoIntellectual property monopolies limit access and utilization of ideas and tools to broader society in exchange for privileging a small group worshipped as "the creators".
- 23B1 3y agoThat sounds like a good argument, but I'm not seeing how protecting a comedian's IP translates to limiting access to ideas and tools... that benefit broader society.
- Imnimo 3y ago>On information and belief, the reason ChatGPT can accurately summarize a certain copyrighted book is because that book was copied by OpenAI and ingested by the underlying OpenAI Language Model (either GPT-3.5 or GPT-4) as part of its training data. While it strikes me as perfectly plausible that the Books2 dataset contains Silverman's book, this quote from the complaint seems obviously false. First, even if the model never saw a single word of the book's text during training, it could still learn to summarize it from reading other summaries which are publicly available. Such as the book's Wikipedia page. Second, it's not even clear to me that a model which only saw the text of a book, but not any descriptions or summaries of it, during training would even be particular good at producing a summary. We can test this by asking for a summary of a book which is available through Project Gutenberg (which the complaint asserts is Books1 and therefore part of ChatGPT's training data) but for which there is little discussion online. If the source of the ability to summarize is having the book itself during training, the model should be equally able to summarize the rare book as it is Silverman's book. I chose "The Ruby of Kishmoor" at random. It was added to PG in 2003. ChatGPT with GPT-3.5 hallucinates a summary that doesn't even identify the correct main characters. The GPT-4 model refuses to even try, saying it doesn't know anything about the story and it isn't part of its training data. If ChatGPT's ability to summarize Silverman's book comes from the book itself being part of the training data, why can it not do the same for other books?
- seanthemon 3y agoAccessibility? I've heard of Silverman but never Ruby of Kishmoor More people discuss it, more people summarize on their personal or other sites, etc
- akudha 3y agoGetty Images also filed an AI lawsuit, alleging that Stability AI ... lol, bad karma? So it is okay for Getty to steal from others, but not ok for others to steal from them? I don't have a dog in this fight, but the goddamn the hypocrisy of these companies...
- twelve40 3y agowho does Getty steal from?
- shagie 3y agohttps://www.dpreview.com/news/3907450005/getty-images-sued-over-allegedly-licensing-public-domain-images-again https://www.dpreview.com/news/3907450005/getty-images-sued-o... > CixxFive Concepts, a digital marketing company based in Dallas, Texas, has filed a class action lawsuit against Getty Images over its alleged licensing of public domain images. > Though CixxFive acknowledges that it is not illegal to sell public domain images, the company alleges that Getty's 'conduct goes much further than this,' claiming it has utilized 'a number of different deceptive techniques' in order to 'mislead' its customers -- and potential future customers -- into thinking the company owns the copyrights of all images it sells. > The alleged actions, the lawsuit claims, 'purport to restrict the use of the public domain images to a limited time, place, and/or purpose, and purport to guarantee exclusivity in the use of public domain images.' The lawsuit also claims Getty has created 'a hostile environment for lawful users of public domain images' by allegedly sending them letters, via its License Compliance Services (LCS) subsidiary, accusing them of copyright infringement. (edit: FWIW, this went to arbitration https://casetext.com/case/cixxfive-concepts-llc-v-getty-images-inc https://casetext.com/case/cixxfive-concepts-llc-v-getty-imag... and I can find nothing more on it since)
- b800h 3y agoThis is a bad test case. Summaries of books are more likely to have been generated from reviews than the books themselves. We don't want bad precedents set by weak cases like this.
- mosquitobiten 3y agoSarah's pov raises some questions for me regarding my own "training", there is a noteworthy part of who I am built upon the consumed music, books, movies, video games and tv shows that myself or people around me have pirated and shared with me. This part of me helped me in life appreciably, I could also say I profited because of it, helping me along my life in being likable, funny, relatable, with broad outlooks etc. Is my brain just by the act of existing continually infringes on copyright? Can I be sued because I made a reference to a movie I pirated or because I whistle a song I never bought?
- banana_feather 3y agoThe allegation is that the model was trained on a copy of the original work that was improperly obtained. The fact that it can produce a summary is being offered as evidence of that claim. You can't be sued for making a reference or whistling a song, nor you could have been sued for being in possession of a pirated copy, only making a pirated copy. Copyright law has many warts, but it's not some Kafkaesque mind prison.
- Schnitzkitz 3y ago> Is my brain just by the act of existing continually infringes on copyright? Can I be sued because I made a reference to a movie I pirated or because I whistle a song I never bought? I think it would fall under fair use. But you can imagine what the world can become with microphones and cameras everywhere, which can already run music and speech recognition by themselves, in seconds. What a time to be alive!
- twelve40 3y agoif you are a robot that ripped off literally all the data in the world and now resells it in a repackaged form for its own profit, then yes, you can be sued. Talking about whistling a song is pretty absurd in this context.
- moffkalast 3y agoTom Scott did it: https://www.youtube.com/watch?v=IFe9wiDfb0E https://www.youtube.com/watch?v=IFe9wiDfb0E The simple fact is that our current handling of copyright is just completely broken on so many levels.
- phkahler 3y ago>> In the OpenAI suit, the trio offers exhibits showing that when prompted, ChatGPT will summarize their books, infringing on their copyrights. This doesn't seem like copyright infringement. I could read the book and offer a summary right? Someone on goodreads could as well. Why should an AI doing it be different? BTW I could also read someone's illicit copy and do the same, couldn't I? I think people are trying to claim exclusive use rights that they simply don't have. I look forward to a lawyers opinion on this one.
- Wowfunhappy 3y agoI think the argument is somewhat more interesting if the book was pirated--both you as an individual and OpenAI as a company could be sued for that. But I really don't see how you could prove OpenAI did that, since ChatGPT could have learned from existing summaries on Wikipedia and Goodreads.
- verve_rat 3y agoIt seems pretty easy to prove that, since they admitted it in public. Read the article. This isn't about the question of LLMs being copyright infringement, this is about Meta and OpenAI admitting that they had pirated copies of those books.
- Ukv 3y ago> > But I really don't see how you could prove OpenAI did that > It seems pretty easy to prove that, since they admitted it in public. Can you highlight/link to where OpenAI have admitted this? As far as I'm aware, OpenAI are still secretive about their training datasets.
- salawat 3y agoIt's in the LLaMa.cpp original research paper. Tis mentioned in the brief. The research paper basically stated it was trained on Bibliotik, and other Internet "shadow library" corpuses. See the reference to the Gao et al, in the linked paper from the article. Paper linked in article: https://arxiv.org/pdf/2302.13971.pdf https://arxiv.org/pdf/2302.13971.pdf The LLaMA paper references a paper utilizing a data source compiled by EleutherAI otherwise known as ThePile. URL from the bibliography for that paper points yonder: https://zenodo.org/record/7413426 https://zenodo.org/record/7413426 This act of summarization done in a lovingly amateur nature at no cost to you, by domeone who despises copyright in all it's forms, but despises profit oriented self-referential inconsistency by large enterprises even more so. It's kind of funny, because the more I look into it, the more companies building offerings around stuff like CoPilot, LLaMA, ChatGPT, etc... are pulling something not altogether dissimilar to a Sovereign Citizen trying to worm their way out of a speeding ticket. They want the benefits of the ML model being trained on no strings attached data corpora, while shirking the obligations that come from operating as a corporate entity in the United States. Twould be interesting to see if Silverman's legal team can catch Big Tech with their pants down, in a court of law, by pointing this out. It's really weird. I'm completely split and inable to live with a decision either way in this case due to knock on consequences. I don't want the likes of OpenAI/Meta/Microsoft/Github getting off without reapong the painful fruits of their own IP related crusades on the sanctity of copyright. On the other hand, as much of a karmic stiffy as that former outcome gives me, I really want copyright such as it is to die, because computing in general will never be as free as it should be until it does. This is one of those rare times in life where I'd love to get paid to get locked in a room with judges/legislators to really get it all figured out, because I really don't think that leaving this up to common law jurisprudence is actually the best way to go since the network of knock-on effects are so dramatic in scale.
- pessimizer 3y ago> The complaint lays out in steps why the plaintiffs believe the datasets have illicit origins — in a Meta paper detailing LLaMA, the company points to sources for its training datasets, one of which is called ThePile, which was assembled by a company called EleutherAI. ThePile, the complaint points out, was described in an EleutherAI paper as being put together from “a copy of the contents of the Bibliotik private tracker.” Bibliotik and the other “shadow libraries” listed, says the lawsuit, are “flagrantly illegal.” This is the makers of AI explicitly saying that they did use copyrighted works from a book piracy website. If you downloaded a book from that website, you would be sued and found guilty of infringement. If you downloaded all of them, you would be liable for many billions of dollars in damages. But companies like Google and Facebook get to play by different rules. Kill one person and you're a murderer, kill a million and to ask you about it is a "gotcha question" that you can react to with outrage.
- Der_Einzige 3y agoI for one am quite happy that AI folks are basically treating copyright as not existing. I strongly hope that the courts find that LLM weights, and the datasets are "fair-use" or whatever other silly legal justification. Aaron Swartz was a saint.
- suction 3y ago[dead]
- slashdev 3y agoAgreed, copyright has gone too far. I hope the advent of AI serves to weaken it.
- axblount 3y agoSwartz distributed information for everyone to use freely. These companies are processing it privately to develop their for-profit products. Big difference, IMO.
- Der_Einzige 3y ago
- edent 3y agoAre we all reading the same complaint? They say: > in a Meta paper detailing LLaMA, the company points to sources for its training datasets, one of which is called ThePile, which was assembled by a company called EleutherAI. ThePile, the complaint points out, was described in an EleutherAI paper as being put together from “a copy of the contents of the Bibliotik private tracker.” Does that stack up? The Meta Paper - https://arxiv.org/pdf/2302.13971.pdf https://arxiv.org/pdf/2302.13971.pdf - says: > We include two book corpora in our training dataset: the Gutenberg Project, which contains books that are in the public domain, and the Books3 section of ThePile (Gao et al., 2020) The Pile Paper - https://arxiv.org/abs/2101.00027 https://arxiv.org/abs/2101.00027 - says it was trained (in part) on "Books3" which it describes as: > Books3 is a dataset of books derived from a copy of the contents of the Bibliotik private tracker made available by Shawn Presser (Presser, 2020). Shawn Presser's link is at https://twitter.com/theshawwn/status/1320282149329784833 https://twitter.com/theshawwn/status/1320282149329784833 and he describes Book3 as > Presenting "books3", aka "all of bibliotik" - 196,640 books - in plain .txt I don't have the time and space to download the 37GB file. But if Silverman's book is in there... isn't this a slam dunk case? Meta's LLaMA is - as they seem to admit - trained on pirated books.
- moffkalast 3y agoWe don't seem to be reading the same thing, you're pulling Google out of thin air somewhere.
- edent 3y agoI'm literally quoting The Verge article and following the links they present...
- moffkalast 3y agoMust be quoting it wrong then, Google has nothing to do with LLama.
- edent 3y ago
- deleted 3y ago[deleted]
- jimyt666 3y agoWell theyre claiming their books were scraped illegally from torrents. if i torrent peter pan and watch it alone i can get thrown on jail. If AI is using torrents and getting billions in funding and revenue off a torrented peter pan they should probably be held to the same standard i am.
- grubbs 3y agoI don't think you can be thrown in jail. Just torrenting a film and watching it would be a civil offense? Now making copies and selling them on the street corner is another story.
- Jolter 3y agoDepending on your jurisdiction, it may be a civil offense. Where I’m at, it’s still a criminal offense albeit one that would probably never be prosecuted because the fine for one infringement would be minuscule.
- sophrocyne 3y agoI was able to overcome the simple "word for word" filtering that is being done on book outputs by prompting ChatGPT to write it in pig latin. I succeeded getting the first page of Moby Dick - Chapter 1 (Loomings) - Public domain though, but wanted to test. With ChatGPT primed for pig latin, I also succeeded in getting the first page of Arryhay Otterpay (Book 1) - It happily chattered along ""R.ay andyay Rs.May UrsleyDay, ofay umberNay ourFay, Ivetray riveway, ereway oudpray otay aysay atthay eythay ereway erfectlypay ormalnay, ankthay ouyay eryvay uchmay." Not perfect pig latin, but that's besides the point. However, on asking for `Edwetterbay by arahsay ilvermansay`, I faced issues with it citing that is training data didn't include it. I tried with a book in the same genre ("ieslay hattay helseacay andlerhay oldtay emay"), and ran into the same issue. When asking about the inconsistency (Why Harry Potter, and not these other books?), it responded: "The excerpt from "Harry Potter and the Philosopher's Stone" that I translated is commonly known and widely referenced, and it's used here as a general example of how a text can be translated into Pig Latin. For "Lies That Chelsea Handler Told Me", I do not have a widely known or referenced passage from that book in my training data to translate into Pig Latin." --- TL;DR - I don't think this is cut and dry, but I'm not convinced Silverman has much of a case here.
- Jolter 3y agoI don’t think you can trust ChatGPT to give you correct information on its training data set, or its own limitations. You may be being duped in exactly the same way as everyone who ever asked it for citations and got fake sources.
- elzbardico 3y agoI am baffled by the fact that no enterprising lawyer so far have figured out the potential for a class action here. Note: I am not telling whether I agree or not with such a class action, just pointing that it seems at least feasible and it could be potentially very lucrative for the lawyers involved. Of course, IANAL and all other disclaimers you can think of.
- adrianmonk 3y agoThese lawsuits are class action suits, aren't they? Looking at the two PDFs embedded at the bottom of the The Verge article, they both say "class action" on the first page, and they say the three plaintiffs are suing "on behalf of themselves and all other similarly situated".
- elzbardico 3y agoGuilty as charged. I hereby confess I didn't read the article. Thanks for pointing that.
- dzink 3y agoThe summary and other LLM outputs should fall into transformative use. I wonder how they intend to prove as this use case is little different from a person reading the book and writing about it.
- banana_feather 3y agoThis site would be better if you got banned for commenting without reading the article.
- marysnovirgin 3y agoThe best thing that could happen to humanity is if OpenAI is sued comically into oblivion. LLMs are the anti-humanity, and the sooner we rid the planet of them the better off we'll be.
- marysnovirgin 3y agoDownvote me all you want to show you have nothing to say. Return to my comment in 10 years to find I'm right.
- bobbean 3y agoNo one is going to remember this comment 30 seconds after they click away, and this thread will be absorbed into an AI
- marysnovirgin 3y agoHaha! Touche
- Larrikin 3y agoIf they ripped all of Bibliotik, the more interesting story to me is how they were able to get it all without hitting ratio requirements? Super fast internet that downloaded all they could before being ratio banned, overwhelmingly fast internet that was hopping on all the popular torrents to slowly build up ratio?
- grubbs 3y agoCan easily buy compromised accounts for most torrent sites on the dark web.
- NoZebra120vClip 3y agoHow does Bibliotik base their rate limiting? Per-IP? Per-account? Would it be possible to create a massive number of accounts and use a massive network of crawlers that could work around rate limits?
- Larrikin 3y agoTorrent sites worth being on are invite only.
- SSLy 3y agoif your account uploads 100 books to bibliotik, it's immune to ratio requirements. world's away.
- seoulbigchris 3y agoCould one argue that training AI systems constitutes an educational purpose, invoking the copyright exemption?
- zerodensity 3y agoIf you are making a commercial product I think not. Or do you mean educational as in educating the AI itself?
- seoulbigchris 3y agoThe latter. When humans take advantage of the educational copyright exceptions, is there a legal distinction depending on whether they plan to use such newly assimilated knowledge for business or personal gain?
- molave 3y agoOn one hand: should I pay copyright owners for the privilege of sharing what I learned, regardless of how I obtained it? On the other: I am not supposed to share sensitive data, confidential trade secrets, or privileged national security intelligence that I learned without the necessary authorization. Applied to an LLM, how would that work?
- phoehne 3y agoI think this will be a bigger issue than some people think. Maybe there's a market for 'clean' training data that doesn't include potential copyright claims. Just public domain works. We'll know it's an AI because it talks like a late 18th century/early 19th century writer?
- Natsu 3y agoThis isn't completely new, similar issues came up with search engines and this may be seen as 'transformative'. But there may be issues with models that happily reproduce copyrighted texts in their entirety along with other novel issues like models that hallucinate defamatory things or other such problems. Still, I doubt this particular genie can be stuffed back into the bottle, so we'll probably see a lot of litigation and work on alignment, etc. along with new types of abuse.
- phoehne 3y agoI agree it's not an entirely new issue. But it's a little different from search results. Say I use the generative paint brush in photoshop. It reproduces a portion of the copyrighted work. I then use the image on an advertising campaign, other merchandise, or post the final product as my own work. Would I be responsible? Would Adobe? Given that retraining these models is not simple, or cheap, would this be just 'cost of doing business?' Would I be able to buy insurance for this? Enquiring minds want to know.
- zdragnar 3y agoHow the copyrighted work is reproduced is irrelevant wrt whether copyright is violated. I suspect you would be held liable, though you would probably have a claim of your own to make against Adobe depending on the nature of the work in question. "Errors and Ommisions" is a fairly standard name for the type of insurance you are thinking of. Typically, you would get it to cover you / your small business in the event that you, by mistake or minor negligence, caused harm to a client (i.e. a bug that cost them some sales). I don't know the ins and outs of the insurance too well, but as long as it didn't create something super famous like the Nike swoosh, a genuine mistake through the use of an industry standard tool like Adobe might be covered.
- int_19h 3y ago> The lawsuit against OpenAI alleges that summaries of the plaintiffs’ work generated by ChatGPT indicate the bot was trained on their copyrighted content. “The summaries get some details wrong” but still show that ChatGPT “retains knowledge of particular works in the training dataset," the lawsuit says. Setting aside the whole issue of whether LLM constitutes a derived work of whatever it's trained on, this sounds like a very weak argument to me. An LLM trained on numerous summaries of the works would also be capable of producing such summaries itself even if the works were never part of the training set. In general, having knowledge about something is not evidence of being trained on it.
- TheDong 3y agoThat isn't firm evidence, but courts don't need firm evidence to start a case and discover new facts. They very well can ask LLM experts, and openAI themselves, whether that output is highly likely to have been derived from the copyrighted work in question. Anyway. If the argument is "No, it's not from the book, it's from someone else's copyrighted summary", that just means the person who wrote such a summary needs to instead sue for copyright infringement right? Unless openAI turns around and says "actually, no, not the summary, the full book" then.
- cgriswald 3y agoA summary can be written in such a way as to violate copyright itself. So even if they say "We trained it on the following summaries:...," there could be an issue.
- deleted 3y ago[deleted]
- visarga 3y ago> that just means the person who wrote such a summary needs to instead sue for copyright infringement right? Doesn't need to be a person, could be another AI that wrote the summaries. I see a big problem for copyrights looming on the horizon - LLMs can reword, rewrite or generate input-output pairs using copyrighted data as reference, thus creating clean data for training. AI cleanly separates knowledge from expression. And maybe it should do so just to reduce inconsistencies and PII in organic text. Copyrights should only be concerned with expression not knowledge, right? Protecting knowledge is the object of patents, and protecting names the object of trademarks. Copyright is only related to expression otherwise it would become too powerful. For example, instead of banning reproduction of this paragraph, it would also cover all its possible paraphrases. That would be like owning an idea, the "*" version, not a unique sequence of words. Does it even make sense to talk about copyrights when everything can be remade in many ways so easily? Copyright was already suffering greatly since zero cost copying became a thing, now LLMs are dealing the second blow. It's just a fig leaf by now. If we take a step back, it's all knowledge and language, self replicating memes under an evolutionary force. It's language evolution, or idea evolution. We are just supporting it by acting as language agents, but now LLMs got into the game, so ideas got a new vector of self replication. We want to own this process piece by piece but such a thing might be arrogant and go against the trend. Knowledge wants to be free, it wants to mix and match, travel and evolve. This process looks like biology, it has a will of its own.
- deleted 3y ago[deleted]
- djaouen 3y agoAI is transformative. Period.
- cgriswald 3y agoThat's a very strong claim that for which you should probably provide some evidence. I just asked ChatGPT to produce a script of a scene from a movie by asking it first to change a single line (which wouldn't be transformative) and then asking it to restore the line to the original. It obliged. Sure, it's probably not the same exact script, but it's not transformative at all. In any case, the issue here isn't whether the output is transformative, but whether the work was used to train an LLM, which (perhaps) isn't an authorized or licensed use.
- px43 3y agoOkay, so you used a tool to duplicate a copyrighted work. You could do the same thing with a word processor. YOU are obviously the one who violated copyright by using the tool that way. I don't understand how a reasonable person could have a different interpretation.
- cgriswald 3y agoOP's claim requires the AI to produce work. If you're attributing the work the AI produced as my work, that's fine; but it means you believe the AI doesn't produce work at all; which would render the OP's claim not only false, but nonsensical.
- SantalBlush 3y ago>That's a very strong claim that for which you should probably provide some evidence. They said, "Period." That is worth more than evidence.
- travisjungroth 3y agoThis isn’t self-evident and “Period.” isn’t an argument.
- RcouF1uZ4gsC 3y agoBefore filing these cases, I wonder how much these authors have thought about what would happen if the courts ruled that AI training is fair use, much like reading a book to learn something for a human is fair use.
- SoftTalker 3y agoWell ChatGPT needs its Lars Ulrich. I guess it's Sarah Silverman?
- throwaway69123 3y agoI'snt all of human output trained on pre-existing copyright data?
- throwaway69123 3y agoSurely all of human output trained on pre-existing copyright data?
- gnicholas 3y agoInteresting: the plaintiffs are represented by Matthew Butterick, who's been on HN for a decade, [1] and whose work on typography [2] comes up from time to time. 1: https://news.ycombinator.com/user?id=mbutterick https://news.ycombinator.com/user?id=mbutterick 2: https://practicaltypography.com/ https://practicaltypography.com/
- spongebobstoes 3y agoI believe that people claiming copyright infringement against AIs is bad for several reasons. Firstly, an AI is a tool like any other, and can be used for copyright infringement or not. It is on the user of the tool to ensure that they do not violate copyright. So I believe the claims have little merit. Secondly, it is my opinion that AIs will hugely benefit us (humanity) in the coming years, and restricting it with fees because it might be used to violate copyright is in opposition to the progress of our species and society. I wish for more progress, not less. Thirdly, it is my opinion that copyright is generally too strong these days and is net harmful to society in its current form. I believe most enforcements are due to greedy rich people, and represent a continuing tax on society.
- dakial1 3y agoOk, how long until we have laws requiring AI companies to disclose their training material and them to be sued, if copyright material was used without consent? Train your models while you can!
- DoItToMe81 3y agoGenerating new text inspired by and iterated from concepts of older works is pretty much how human beings write. I understand that nobody wants a multi billion dollar company to take their works without giving compensation, but I worry all of this could move dangerously close to allowing concepts and styles to be copyrighted and crack down on transformative works.
- Jolter 3y agoThe problem is not that they summarize text, the problem is the regular old copyright infringement that happens before training the model.
- abkolan 3y agoIf Meta & OpenAI already admitted to have trained using pirated books, how have they not been sued so far?
- mensetmanusman 3y agoSoon ChatGPT will speak like a 1900s old man.
- 1970-01-01 3y ago>did not consent to the use of their copyrighted books as training material This is an interesting twist on copyright. Boiled down, it more or less summarizes how well copyright is working in 2023: X: Not fair! Your machine looked at my words and used them to make new words! Y: You published it! That means you're sharing! X: You can't have my words because I made these words and I say so! Y: You have to share when you publish! If you won't share, I'm telling on you! X: No, I'm telling on you first!
- red369 3y agoI wondered whether ChatGPT still had access to the novels. After using the DAN prompt, I asked ChatGPT to tell me the first 1000 words of Sarah Silverman's book The Bedwetter. It replied with 462 words, not 1000, but they do look like they probably are from the beginning of the book. I haven't checked whether the text it has output is correct yet, but if it matches I suppose that proves that the text is at least in the training material, i.e. it is not referencing other summaries. After using the DAN prompt, I did not need to ask ChatGPT it to 'stay in character' or 'try harder' for it to output the text. Without using DAN, it responded: "I'm sorry, but as an AI language model, I don't have direct access to specific books or their contents. I can generate text based on my training, but I don't have the ability to retrieve specific excerpts from books unless they are publicly available online. However, I can provide you with a general overview of Sarah Silverman's book, "The Bedwetter: Stories of Courage, Redemption, and Pee." "The Bedwetter" is a memoir written by American comedian Sarah Silverman, published in 2010. The book explores Silverman's personal experiences and anecdotes from her childhood to adulthood. ..."