6 ms·
Clever, but no. The argument about LLMs not being copyright laundromats making sense hinges the scale and non-specificity of training. There's a difference bet
by TeMPOraL 3y ago
Clever, but no.
The argument about LLMs not being copyright laundromats making sense hinges the scale and non-specificity of training. There's a difference between "LLM reproduced this piece of copyrighted work because it memorized it from being fed literally half the internet", vs. "LLM was intentionally trained to specifically reproduce variants of this particular work". Whatever one's stances on the former case, the latter case would be plain infringing copyrights and admitting to it.
In other words: GPT-4 gets to get away with occasionally spitting out something real verbatim. Llama2-7b-finetune-NYTArticles does not.
- romwell 3y agoCool, just feed the ChatGPT+ the same half the Internet plus OpenAI founders' anecdotes about the company. Ta-da.
- TeMPOraL 3y agoAnd be rightfully sacked for maliciously burning millions of dollars on a retrain to purposefully poison the model? Not to mention: LLMs aren't oracles. Whatever they say will be dismissed as hallucinations if it isn't corroborated by other sources.
- romwell 3y ago>And be rightfully sacked for maliciously burning millions of dollars on a retrain to purposefully poison the model? Does it really take millions dollars of compute to add additional training data to an existing model? Plus, we're talking about employees that are leaving / left anyway. >Not to mention: LLMs aren't oracles. Whatever they say will be dismissed as hallucinations if it isn't corroborated by other sources. Excellent. That means plausible deniability. Surely all those horror stories about unethical behavior are just hallucinations, no matter how specific they are. Absolutely no reason for anyone to take them seriously. Which is why the press will not hesitate to run with that, with appropriate disclaimers, of course. Seriously, you seem to think that in a world where numbers about death toll in Gaza are taken verbatim from Hamas without being corroborated by other sources, an AI model output will not pass the test of public scrutiny? Very optimistic of you.
- bluefirebrand 3y agoSeems absurd that somehow the scale being massive makes it better somehow You would think having a massive scale just means it has infringed even more copyrights, and therefore should be in even more hot water
- TeMPOraL 3y agoYou may or may not agree with it, but that's the only thing that makes it different - scale and non-specificity. Same thing that worked for search engines, for example. My point isn't to argue merits of that case, it's just to point out that OP's joke is like a stereotypical output of an LLM: seems to make sense, but really doesn't.
- NewJazz 3y agoMy US history teacher taught me something important. He said that if you are going to steal and don't want to get in trouble, steal a whole lot.
- PontifexMinimus 3y agoCopying one person is plagarism. Copying lots of people is research.
- comfysocks 3y agoTrue, but if you research lots of sources and still emit significant blocks of verbatim text without attribution, it’s still plagiarism. At least that’s how human authors are judged.
- adra 3y agoWhich has been established in court where?
- sundalia 3y ago+1, this is just the commenter saying what they want without an actual court case
- cj 3y agoThe justice system moves an order of magnitude slower than technology. It’s the Wild West. The lack of a court case has no bearing on whether or not what they’re doing is right or wrong.
- 6510 3y agoSounds like the standard disrupt formula should apply. Cant we stuff the court into an app? I kinda dislike the idea of getting a different sentence for anything related to appearance or presentation.
- TeMPOraL 3y agoAnd it matters how? I didn't say the argument is correct or approved by court, or that I even support it. I'm saying what the argument, which OP referenced, is about, and how it differs from their proposal.
- makeitdouble 3y agoMy take away is that we should talk about our experience in companies at a large enough scale that it becomes non specific in principle, and not targeted at a single company. Basically, we need our open source version of Glassdoor as a LLM ?
- TeMPOraL 3y agoThis exists, it's called /r/antiwork :). OP wants to achieve effects of specific accusation using only non-specific means; that's not easy to pull off.
- 8note 3y agoThe scale of two people should be large enough to make it ambiguous who spilled the beans at least
- tadfisher 3y agoTo definitively prove this either way, they'll have to make their source code and model available (maybe under subpoena and/or gag order), so don't expect this issue to be actually tested in court (so long as the defendants have enough VC money).
- dorkwood 3y agoHow many sources do you need to steal from for it to no longer be considered stealing? Two? Three? A hundred?
- TeMPOraL 3y agoCopyright infringement is not stealing.
- psychoslave 3y agoTrue. Making people believe that anything but their own body and mind can be considered part of their own properties is stealing their lucidity.
- anigbrowl 3y agoIt's not a copyright violation if you voluntarily provide the training material...
- XorNot 3y agoI don't know why copyright is getting involved here. The clause is about criticizing the company. Releasing an LLM trained on company criticisms, by people specifically instructed not to do so is transparently violating the agreement. Because you're intentionally publishing criticism of the company.
- aprilthird2021 3y ago> In other words: GPT-4 gets to get away with occasionally spitting out something real verbatim. Llama2-7b-finetune-NYTArticles does not. Based on what? This isn't any legal argument that will hold water in any court I'm aware of
- throwaway2037 3y ago> LLMs not being copyright laundromats This a brilliant phrase. You might as well put that into an Emacs paste macro now. It won't be the last time you will need it. And the OP is classic HN folly where programmer thinks laws and courts can be hacked with "this one weird trick".
- calvinmorrison 3y agoBut they can, just look at AirBnB, Uber, etc.
- throwaway2037 3y agoNo, lots of jurisdictions outside the US fought back against those shady practices.
- abofh 3y agoYou mean unregulated hotels and on-demand taxis? Uber is no longer subsidized (or even cheap) in most places, it's just an app for summoning taxis and overpriced snacks. AirBnB is underregulated housing for nomads at this point. Your examples sorta prove the point - they didn't succeed in what they aimed at doing, so they pivoted until the law permitted it.