6 ms·
NY times is asking that all LLMs trained on Times data be destroyed
- Banditoz 3y agohttps://nitter.net/Dan_Jeffries1/status/1741053245756211560 https://nitter.net/Dan_Jeffries1/status/1741053245756211560
- bag_boy 3y agoWhat is nitter?
- hipsterstal1n 3y agoAlternative open-source Twitter front-end where you can browse posts and not have to sign-in. More here: https://en.wikipedia.org/wiki/Nitter https://en.wikipedia.org/wiki/Nitter
- andai 3y agoAlso Nitter loads in about 1 second. Just compared with Twitter, Twitter takes 14 seconds.
- deleted 3y ago[deleted]
- Der_Einzige 3y ago"I call on @facebook, @cohere, @AnthropicAI, @MistralAI, @huggingface, @google and everyone else who cares about the future of AI to join the defense and smash the NYT in court for this overreaching attempt to twist and expand copyright to the determinant of pretty much everyone else on Earth but the NY Times." Preach it louder! I think most of them (certainly Huggingface and Mistral) will be ready to help on this. Let's hope that big tech companies are savvy at getting better lawyers who can more clearly articulate the pro-LLM position to lawmakers.
- nullindividual 3y agoIf an LLM scrapes a source code repository that requires attribution, will you also preach to tech companies to go after said license?
- brookst 3y agoWhat license requires attribution to read and understand the code? Or to use techniques from code for totally different purposes, embodied in different code? You may have a point for verbatim regurgitation of code, but I’m having a hard time seeing a violation in ingestion code and learning how it works.
- oldkinglog 3y ago> What license requires attribution to read and understand the code? BSD, MIT, several others. Without a license you cannot read the code.
- kragen 3y agoreading has never been one of the rights reserved to copyright holders under us copyright law, and in fact there are a number of carve-outs in us copyright law to ensure that copyright holders cannot prevent people from reading their work, such as the first-sale doctrine and the exemption for copying an executable into memory there have at times been regimes that legally restricted the mere reading of published works, but such policies have generally been considered repugnant to liberal democracy and indeed liberalism in general
- dmbche 3y agoThat using copywritten text in a commercial goal is not a breach of copyright? It's gonna take Robert Kardashian to get that through
- deleted 3y ago[deleted]
- croes 3y agoWhy call Facebook and Co.? Call Microsoft. I bet the NYT relies on MS's OS, Software and Cloud services. That's a lot more leverage.
- Hasu 3y agoMicrosoft and OpenAI are the ones being sued. The call is for other AI companies to help them defend the case. Microsoft doesn't have a choice here.
- croes 3y agoI doubt that Copilot is trained on NYT texts and MS isn't the owner of any GPT.
- Hasu 3y agohttps://www.documentcloud.org/documents/24241000-2023-12-27-nyt-dkt-1-complaint https://www.documentcloud.org/documents/24241000-2023-12-27-... Microsoft is the first defendant listed. You can read the Times' claims against Microsoft.
- donohoe 3y agoThey don't really.
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- seo-speedwagon 3y agoIt’s like Gretzky says, you miss 100% of the shots you don’t take.
- ldjkfkdsjnv 3y agoA last grasp at relevance from the NYT
- jacobsenscott 3y agoWho is this guy, basically doing the equivalent of cheering on Stalin to collectivise farmland.
- graypegg 3y agoHe’s really snarky in the replies too, telling Simon Willison “your takes are usually better. Do better next time please. :)” [0] So that’s a window into this guy’s personality. [0] https://x.com/dan_jeffries1/status/1741126530590294264 https://x.com/dan_jeffries1/status/1741126530590294264
- deleted 3y ago[deleted]
- AtlasBarfed 3y ago"I call on everyone to defend my corporation, clearly the good guys, against the new York times, clearly the bad guys." Just your usual smiling trendy unkempt beard sociopath corporate marketer in post-corporate business casual trying to hide as a folksy warrior of the people. Or maybe he's an AI generated fuckface profile that cranks out ai generated propaganda for the AI corporation. Well, if he's real he should be prepared to be replaced by one soon, because word salad bullshittery is incontrovertibly the BEST thing llms are capable of.
- oldkinglog 3y agoFor years I've complained about how the MPAA, RIAA and big tech lobby politicians to wreck copyright and force all culture through an ownership sieve. But I might forgive them if it happens to prevent the commercialisation of all remaining human culture via AI.
- wg0 3y agoThere have been issues where a computer science professor claimed an LLM was verbatim generating the code he wrote. Many individual artists have similar claims [0]. Now NYT has. Individuals cannot foot the bill for lawyers so they have no choice but to see it all while being unable to do anything. NYT apparently has the muscle to pull it off. Morality or ethics don't stand a chance here, it is all about who can march the largest army of lawyers which clearly, is the Tech bro clan. I'm sad for all the creators. And of course, those marketing it as "synthetic intelligence" are on a whole another level. [0]. https://youtu.be/jsggOAMQX3Q https://youtu.be/jsggOAMQX3Q
- ceejayoz 3y ago> Morality or ethics don't stand a chance here, it is all about who can march the largest army of lawyers which clearly, is the Tech bro clan. There’s diminishing returns in this regard. Me suing Google has this dynamic, but the NYT is large enough to hire perfectly effective legal counsel. 1000 top lawyers won’t necessarily beat 100 top lawyers.
- surprisetalk 3y agohttps://taylor.town/synthetic-intelligence https://taylor.town/synthetic-intelligence
- bitzun 3y agoNYT's ask and my own are never going to happen, but I think forcing the models to be public domain would be the best outcome. It was trained on the creative output of a substantial portion of everyone online going back decades, including my own.
- WalterBright 3y agoI don't mind if there's a little piece of me somewhere in that model!
- bitzun 3y agoMe neither, as long as I get to own it along with everyone else!
- miguelazo 3y agoSpeak for yourself. People who make their living in (actually) creative fields don’t have the luxury. We’ll see how all the brogrammers feel about industrial scale plagiarism 5 years from now when Gen AI models code better than any human.
- feyman_r 3y agoIsn’t this the case already with the Industrial Revolution where we began mass-producing (mostly) better day-to-day utility items rather than getting from a specific craftsman? I’d think that the clothing industry went through something similar already.
- junon 3y agoI'm in an "(actually) creative" field, not a brogrammer, 20 years of writing code, and have a vastly different opinion than you do.
- WalterBright 3y agoI've been writing code professionally for about 45 years now. People have cribbed my code and ideas since the beginning. At some point, I just stopped caring about it. I no longer sell code, just my services. I did have one case where someone stole my code, and then tried to sue me for copyright infringement. Too bad for him that I had a registered copyright on it :-)
- endisneigh 3y agoWhy is it unreasonable to request they retrain without their content exactly?
- sidcool 3y agoI don't think it's practical. It would almost be like training from scratch.
- endisneigh 3y agoWhy is that their problem? If they didn’t get permission to use copyrighted content why is it unreasonable for retraining to occur without their content? And please spare me the humans learn too nonsense. Computers are not humans.
- unyttigfjelltol 3y agoHumans mostly don't have the ability to reproduce articles verbatim years later and those that can certainly don't have the capacity to serve copies and derivatives to the entire free world ... and even if they did they would quote and paraphrase selectively and non-competitively with attribution to the source. LLMs do all the functions humans can't with none of the guardrails or attribution.
- brookst 3y agoWould it be reasonable for NYT to demand that all humans forget anything learned from NYT articles? The NYT is asserting a drastic expansion of copyright, to cover not just the specific expression of ideas but the ideas themselves. We should be wary of AI companies, and copyright is woefully unprepared for our new world, but the answer is not to change the system so creators retain infinite control over who can even remember their work.
- endisneigh 3y agoComputers are not humans. Why do people continue to make these inane comparisons? Show me a human can remember even half of what GPT4 was trained on and I’ll concede the point.
- pjdemers 3y agoThe end result will be that OpenAI pays the Times a few hundred million dollars for a license. Chump change for OpenAI, but real money for the Times.
- ceejayoz 3y agoThey can’t. Thousands of other orgs would consider that precedent and get in line.
- smith7018 3y ago"A few hundred million dollars" is not chump change to any organization; especially one that is in its growth phase. They raised $300M [1] in their last round so that would wipe out the all of the investment money they brought in. https://techcrunch.com/2023/04/28/openai-funding-valuation-chatgpt/ https://techcrunch.com/2023/04/28/openai-funding-valuation-c...
- Der_Einzige 3y agoIt sure as shit was for Snowflake, who purchased streamlit for 800 million[1]. Streamlit is a python webUI front-end. https://techcrunch.com/2022/03/02/snowflake-acquires-streamlit-for-800m-to-help-customers-build-data-based-apps/?guccounter=1 https://techcrunch.com/2022/03/02/snowflake-acquires-streaml...
- fshbbdssbbgdd 3y agoI’m not a lawyer but it seems to me that the infringement would be in the publication of the output of the models, not in the mere existence of the models. Let’s imagine a really obvious case of copyright infringement - where a shady publisher buys up copywritten books, assembles them into a private library, then prints and sells copies. The infringement is the “prints and sells”, right? Not the “assembles a private library”? If we accept that ChatGPT is committing copyright infringement (which at least seems true if it returns big chunks of the copywritten material verbatim), I don’t think you can get from there to compelling deletion of the model.
- blowski 3y agoA lot of analogies break down here. This is just an early salvo in many arguments to come, that will need reasoned debate by competent people, judged by wise leaders. I really hope we can have that debate.
- crmd 3y agoSimply duplicating copyrighted data is itself a crime in certain jurisdictions.
- unyttigfjelltol 3y agoThe LLM model is fixed somewhere in a tangible medium and it (allegedly) includes an unlicensed copy of a copyrighted work. The LLM spitting that out to users is (allegedly) both an infringement and evidence the model itself is infringing.
- brookst 3y agoIsn’t that a massive misunderstanding of LLMs? If I have infinite monkeys and typewriters, that does not mean the typewriters (or monkeys) contain copyrighted text. LLMs are basically an optimization of infinite monkeys using statistics. I can see how outputs can be infringing copyright, but I’m having a very hard time seeing how the weights can be. It feels like saying a musician is infringing copyright if they understand a song well enough to be able to create an infringing reproduction, even if they don’t.
- TriangleEdge 3y agoI'd argue that training LLM's on news sites makes them less useful anyway. It's not like these sites do any meaningful research. They just disseminate information readily available elsewhere.
- wg0 3y agoAnd LLMs can do meaningful research? Or even consistently produce meaningful output without every hallucinating?
- TriangleEdge 3y agoFollow up Q: can you untrain an LLM, or is OpenAI going to have to retrain without the articles?
- butterfi 3y agoWhile I don’t necessarily agree with the NYT, I fail to see how or why LLMs are entitled to consume other peoples work for their own material gain.
- jmvoodoo 3y agoThat's pretty much the entire point of many publications. You think readers of Financial Times aren't reading FT in the hopes of getting their own material gain? What about Wall St analysts? Consuming something for gain is not copyright infringement, distributing it for gain is.
- edent 3y agoThe people who read the FT usually pay for it. Most of these LLMs are trained on a set of pirated content that they didn't pay for - https://shkspr.mobi/blog/2023/07/fruit-of-the-poisonous-llama/ https://shkspr.mobi/blog/2023/07/fruit-of-the-poisonous-llam... Most copyrighted works will specifically say that the customer / user is prohibited from storing and reproducing those works.
- Vvector 3y agoYet fair use can trump the owner's prohibitions. Your ISP can cache copyrighted materials, storing and reproducing them for other customers. Your browser stores the copyrighted images in your cache and 'reproduces' them if you browse the same page again. It's a complicated area, not clear cut at all
- kgwxd 3y agoIf it’s illegal to make any material gain off skills learned through other people’s work, we’re all criminals.
- feyman_r 3y agoExactly this. If I read a blog summary of a paywalled article that enhances my knowledge and I use it to do my day job better, did I infringe on the original copyright?
- deleted 3y ago[deleted]
- grantseltzer 3y agoCan someone with actual fundamental understanding of LLMs explain to me why they think it's perfectly legal to train models on copyrighted material? I don't know enough about this. Please don't answer by asking chatgpt.
- endisneigh 3y agoIt’s currently not explicitly legal or not. There are lawsuits in progress to determine that very answer.
- formercoder 3y agoI, a human, can read a copyrighted work and then write a new work and own the copyright on that new work as long as it is not substantially the same.
- foogazi 3y agoWhat if you produce a substantially similar work ? Who owns the copyright then ?
- michaelmrose 3y agoIt really hinges on substantially similar. If I copy Harry Potter and change every instance of Harry Potter to Michael Rose surely it's infringing. If I write a coming of age story set in a magical land I'm probably OK. Which do you think LLM produce?
- foogazi 3y agoWhatever you ask and the model will be judged by its accuracy. If you ask for Harry Potter and it gives you Bart Simpson it’s useless.
- michaelmrose 3y agoIt's likely not possible of literally giving you Harry Potter. If you specify it narrowly enough that it qualifies as fan fic its probably exactly what you were going for. After all your word processor is capable of producing infringing works but is not itself an infringing work.
- dmvdoug 3y agoHe may be “author, futurist, thinker and systems architect,” but he doesn’t know how law works. He’s citing a prayer for relief against the specific defendants sued. A court doesn’t have power to order relief against a party not before it. Whatever models may exist beyond those made by the specific defendants in this case are not the targets of that language.
- the_duke 3y agoI'm surprised it took this long for a lawsuite to emerge. Interestingly, I think this going through would actually help the big players (Google/MS/Apple) a lot in the medium term. They sit on huge amounts of training data from their own services and also have the money to acquire copyrighted material, while everyone else would have to build on datasets under a permissive license (like Wikipedia), since scraped data would be a minefield.
- Vvector 3y agoEventually the SCOTUS will have to decide if training is a form of fair use. There are plenty of arguments on both sides. The LLMs built and trained 10 years from now will be much more advanced. Will it be possible for anyone to prove if specific content was used/not used in the training? If the courts rule against fair use, it will be a minefield to enforce.
- londons_explore 3y agoIf I were OpenAI, I would tell the court that the LLM's have now been repaired to never reproduce long passages of any of the training data. I would implement that with a simple post-filter. I would then offer to pay damages of 3x revenue for all historic requests that resulted in 50+ words of Times articles to be reproduced. And an analysis of the logs will probably show that only happened tens of times and total revenue from those requests was like $3.
- kordlessagain 3y agoThe likelihood of a use being considered fair diminishes if it negatively impacts the market value of the original work. For instance, if The New York Times (NYT) argues that AI-generated content is not transformative, being quoted verbatim, it suggests the use is not transformative. This challenges the notion of fair use, implying the AI merely replicated the original content without significant alteration or added meaning. In interactions with AI systems like ChatGPT, the user's intent and query nature significantly influence the AI's output. Regardless of user understanding, the fact that they engage with a generative prediction model is key. This novel use case is a first of its kind. Similar to legal searches, where responsibility rests with the searcher, the intent behind AI queries — whether for research, information, or to demonstrate something about AI functionality — dictates the AI's response. The distinction between the AI's training data (e.g., articles from The Times) and the model's outputs is critical for evaluating transformative use. Each instance must be considered individually to ascertain this. Just as intent is pivotal in legal contexts, it's also relevant when users interact with AI. If a user seeks verbatim content from sources like The NYT, responsibility could shift more towards them. This raises ethical questions about the intent behind the NYT's use of OpenAI's services. If the NYT utilized OpenAI's services contrary to terms of use, such as for illegal activities or spreading misleading information, it would constitute a violation. Similarly, manipulating outputs to damage OpenAI's reputation would also breach these terms. In copyright law, responsibility typically lies with the entity making copies or distributions. However, AI complicates this, as it generates content from various inputs. The user essentially initiates and guides this process through their prompts. OpenAI could respond by filtering any NYT content and requiring users to agree to a legally binding contract. This contract would stipulate conditions for content usage in line with fair use principles, emphasizing a joint responsibility between the user and OpenAI. Such an approach aligns with other services where access is contingent on agreeing to specific terms.
- zeroCalories 3y agoIt's reasonable for NYT to not want LLMs regurgitating their front page, but beyond that I don't care. I don't like that IP lasts so long, especially for content like news.
- ChrisArchitect 3y ago[dupe] Plenty of discussion days ago about this and the case: https://news.ycombinator.com/item?id=38781941 https://news.ycombinator.com/item?id=38781941 https://news.ycombinator.com/item?id=38790255 https://news.ycombinator.com/item?id=38790255 https://news.ycombinator.com/item?id=38781863 https://news.ycombinator.com/item?id=38781863
- dang 3y agoRelated ongoing thread: Things are about to get worse for generative AI - https://news.ycombinator.com/item?id=38814093 https://news.ycombinator.com/item?id=38814093 - Dec 2023 (548 comments) Also: NY Times copyright suit wants OpenAI to delete all GPT instances - https://news.ycombinator.com/item?id=38790255 https://news.ycombinator.com/item?id=38790255 - Dec 2023 (870 comments) NYT sues OpenAI, Microsoft over 'millions of articles' used to train ChatGPT - https://news.ycombinator.com/item?id=38784194 https://news.ycombinator.com/item?id=38784194 - Dec 2023 (84 comments) The New York Times is suing OpenAI and Microsoft for copyright infringement - https://news.ycombinator.com/item?id=38781941 https://news.ycombinator.com/item?id=38781941 - Dec 2023 (861 comments) The Times Sues OpenAI and Microsoft Over A.I.’s Use of Copyrighted Work - https://news.ycombinator.com/item?id=38781863 https://news.ycombinator.com/item?id=38781863 - Dec 2023 (11 comments)
- deleted 3y ago[deleted]
- simonblack 3y agoNY times is asking that all LLMs trained on Times data be destroyed ... because the Times knows that most of the stuff they publish is absolute bullshit and they know that AI trained on that rubbish will be screaming at all of the inconsistencies.