7 ms·
Does free software benefit from ML models being derived works of training data?
- oolonthegreat 5y agoseems to be similar to the argument "GitHub Copilot is not infringing copyright" https://news.ycombinator.com/item?id=27736650 https://news.ycombinator.com/item?id=27736650 : "GPL people should not push for a extension of the copyright because that will strengthen the power of giant corporations", which is completely bogus to me.
- dang 5y agoIt would be good to explain what exactly is bogus. Otherwise a comment like this doesn't really say much more than "nuh uh".
- oolonthegreat 5y agoI thought it was blatantly dishonest: "GPL people should ignore GPL violations because pursuing them will make them look like the giant corporations" is clearly not a defendable argument (although I might be building a strawman here)
- mjg59 5y agoI'm not saying we should ignore GPL violations. I'm saying we should consider whether the greater benefit for free software would be in them not being violations in the first place.
- Dylan16807 5y agoPursuing violations is a very different thing from wanting an extension of copyright. It's very valid to want the former and not the latter.
- lmm 5y ago> If software weren't copyrightable, the GPL would have no power. But this is the outcome Stallman wanted! The GPL doesn't exist because copyright is good, it exists because software being copyrightable is what enables the concept of proprietary software in the first place. This isn't really true when software is distributed in binary form - or, increasingly, run on servers and not distributed at all. The outcome Stallman wanted is that end users would have the ability to fix bugs, and add new features, in software they were using. If software is uncopyrightable then that removes one barrier, but not necessarily the most severe one; if you're relying on cloud software whose actual implementation kept as a trade secret (for example) then you still can't fix the problems that are disrupting your workflow. > If Github's interpretation of copyright law holds, we can train a model on proprietary code and extract concepts without having to worry about being tainted. The proprietary code itself won't enter the commons, but the ideas it embodies will. No more worries about whether you're literally copying the code that implements an algorithm you want to duplicate - simply start typing and let the model remove the risk for you. I think the closest analogy is to source code leaks like the famous Windows 2000 one. Would having such leaks be non-copyrightable help free software? I doubt it - even a deliberately released "code dump" is still difficult to learn much from, and even free-software projects have to put a lot of time and effort into documenting their code structure, having a contributor onboarding process and so on. The value of the GPL isn't that it forces people to make their raw code available - "hostile" (L)GPL code, like early WebKit or xlvns, has never made for successful projects - the value is that it creates an environment where people are actually cooperating on software development in a positive way. I think that's more likely to happen in a world where you can only use Copilot-like tools if your software is free than in a world where no such rule exists.
- PeterisP 5y agoIf software wasn't copyrightable, then a leak of (say) windows 8 would not "help free software" by allowing to learn or copy from that, but rather that it would instantly create a "free-windows-8" that could get maintained with security patches by the community, and companies could use windows 8 forever for free instead of buying windows 10 or 11 licenses.
- 5y ago
- ghoward 5y agoThe problem with this article is that it assumes that Stallman's intent would lead to the end result that Stallman wants, and that what Stallman wants is good. I believe this is wrong, either in one way or the other. As far as I understand it, Stallman wants users to have the right to hack on software that they use and to be protected from bad software because of that ability to hack, like right to repair protects consumers on the hardware side. Well, if GitHub Copilot can wash away copyright, companies will quickly realize that opening their source just allows their competitors to wipe away whatever edge they get from their software by keeping changes secret. They will use that reason to close more of their software to preserve their trade secrets. In other words, if copyright wouldn't apply to software anymore, then companies would protect their software by trade secrets instead, leading to less open source, which would lead to less user freedom to hack, especially since such trade secret controls might be used against users themselves. So I would argue that if Stallman wants copyright to disappear, he wants the wrong thing because it conflicts with his goal of user freedom, and Copilot is a problem. If he doesn't, then he will absolutely care about Copilot because Copilot will still be a problem since licenses use copyright to protect users. I can't stress that amount. Our copyright on our software protects our users, and as such, we should guard it jealously. Not for our sake, but for theirs.
- joe_the_user 5y agoPlus there's nothing in Copilot that would weaken the copyright of closed source software - pirated copies of Windows and first-run movies would remain exactly as illegal as before. The "weaken copyright" claim is some bad-reasoning I'm groping for a word to describe. It's as if Google stole stuff from several small companies and someone said "at least it weakens 'the corporations'".
- ghoward 5y agoThis. Very much this.
- mjg59 5y agoWhat trade secret controls do you imagine could be used against users? Once you've lawfully obtained a piece of software, trade secret law doesn't protect against reverse engineering.
- andyxor 5y agothese ML models are basically a fuzzy autocomplete. If you use a third-party autocomplete indexed on proprietary code who's legally liable
- einarfd 5y agoA lot of the comments around Copilot seems to be under the impression that courts care about how you "write" your code. I think this naive at best, why would they and why would the law? If you have a piece of code that would be infringing if you wrote it in Emacs. How can it not be infringing if it was written by VSCode and Copilot? I just don't see how any court would hand down such a judgment. What I do think that Github could get away with, is not being liable for copyright infringement in my code if I used Copilot and it gave me some code that infringed. But that would just move that liability to me. Good for Github, not so good for me.
- darig 5y ago> If you have a piece of code that would be infringing if you wrote it in Emacs. How can it not be infringing if it was written by VSCode and Copilot? I just don't see how any court would hand down such a judgment. If Emacs had Copilot, and Copilot could completely take over all decision making regarding the design and construction of the code, and could reproduce an entire copyrighted work by repetitively hitting the same key over and over, then would a stanley nickle be worth more or less than a leprechaun?
- mjg59 5y agoIt can't be violating if it's not a derived work, and if courts conclude that the output of an ML model isn't derivative of its training material (which is, I understand, the current situation in the US) then it doesn't matter how similar it looks to some other code.
- einarfd 5y agoA blanket "the ML model's output is not at derivative of the input" from a legal perspective. Seems wrong to me, for some types of model sure that might right. For example if you train a model on recognition pictures of houses, then sure even if the pictures you used where copyrighted, the output of that model, wouldn't be. But that that generalize to one that created pictures of houses, and started outputing copies of the input pictures, that I would be surprised if was OK. So I'll agree that for some models the output isn't a legally derived from the input, but all, no I don't think that is true. If running the data through a ML model, removes the copyright. Then we could always train models with specific input to remove copyright on that data, and we follow through on that. We could easily remove copyright on anything, and that would, if the courts upheld that. Be the death kneel for copyright. Can't really see that happening. But maybe that is just my limited imagination.
- 6gvONxR4sf7o 5y agoI’m a broken record at this point, but the focus on GPL code seems secondary to the massive repetition of all-rights-reserved content. I recently tried entering “chapter one: the boy who lived” as a prompt into gpt-3, and it was happy to spit out chapter one of Harry Potter, verbatim.
- einarfd 5y agoSomeone should definitely tell J. K. Rowling about that. She might be in a position to do something about this, and she definitely needs something more useful to focus her unhappiness and frustration at.
- kouteiheika 5y agoYep. So we either 1) declare this to not be copyright infringement, or 2) basically outright outlaw training of interesting ML models. I personally believe that (1) is the way to go, and I find the whole outrage about Copilot to be essentially akin to collectively shooting ourselves in the foot in the long run. I think we shouldn't forget why copyright exists in the first place. To quote the copyright clause of the US constitution (emphasis mine): > "*To promote the Progress of Science and useful Arts*, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries." If anything we already went too far with how draconian modern copyright enforcement is, up to the point that it often actively hampers our progress. Please don't make it even worse!
- michaelmrose 5y agoHow would you go about 1 given existing law, precedent, and circumstances. Would you dramatically expand what you can legally borrow without infringing or just allow wholesale automated washing from one copyright to another? What do you do when random corp starts shutting down open source over ownership of code it swiped from project claiming infringement?
- mjg59 5y agoWhat existing law, precedent, and circumstances demonstrate that the output of an ML model is a derived work of the training data?
- est31 5y ago> If Github's interpretation of copyright law holds, we can train a model on proprietary code and extract concepts without having to worry about being tainted. IANAL, but it can be more fine grained than that. For example, courts may very well care if you obtained a copy of the source code legally before you trained the AI on it, or whether the source code copy comes from a hack or a leak. There is a difference in a court declaring that a rental agreement's clause that no parties may be hosted by the renter is void, and someone breaking into someone elses home and hosting a party there. Proprietary source code that you can obtain legally does exist, but it's a much smaller category than proprietary code in total. In the worst case, this might render copyleft unenforceable while doing nothing to most proprietary code.
- spullara 5y agoYou can obtain the Windows source code legally. Lots of companies offer this to their big customers. https://www.microsoft.com/en-us/sharedsource/ https://www.microsoft.com/en-us/sharedsource/
- formerly_proven 5y agoThis idea does not work for multiple reasons: - You can keep things secret without copyright being involved at all. Something like the Coca-Cola recipe isn't protected by copyright, but by secrecy. No problems to apply this to proprietary software. - SaaS and PaaS make distribution terms irrelevant and secrecy very easy. Open source for the user lost a number of years ago, the reason companies embrace it is because it commoditizes components, i.e. lowers cost, because it's literally free stuff.
- cgio 5y agoI find this line of argumentation unconvincing, given that open source provides the source for models to learn while closed source does not and therefore there will not be derivative works of closed source at least from a copilot use case point of view. Nevertheless, there was a link a couple weeks ago for a NN that replicated GTA. I wonder if that is more along the lines of what the author wanted to argue? I.e. if I can have a NN learn and replicate windows, would MS be ok with it?
- mjg59 5y agoThe majority of public repositories on Github aren't "open source" - there's no associated license that grants you any right to use or modify the code. Copilot is trained on them regardless.
- NmAmDa 5y agoThey rely on the fact that you granted them this right by agreeing to their ToS which allows that use. I doubt any court would consider this illegal.
- mjg59 5y agoI didn't say otherwise? The comment I replied to said: > there will not be derivative works of closed source at least from a copilot use case point of view. which is inaccurate, since many public repositories on Github aren't open source and ended up in Copilot's training corpus anyway.
- b3morales 5y agoThis is quite an ambitious claim. Certainly the GitHub TOS grants them some common-sense ability to copy the code you upload so that they can usefully host it. Can you point to the portion that allows them to use it for Copilot? Because I'm pretty sure it doesn't. Section D4: > This license does not grant GitHub the right to sell Your Content. It also does not grant GitHub the right to otherwise distribute or use Your Content outside of our provision of the Service...
- CogitoCogito 5y agoIf Microsoft truly believes they are in the right, they should publicly (and legally) state that _Microsoft_ (and not he users of copilot) takes on all responsibility for potential future copyright infringement cases against the users of copilot. If they don't do that, it's hard to take any of their claims seriously.
- d4rti 5y agoOr train the model on their own proprietary code base too?
- CogitoCogito 5y agoAt a minimum they should do that, but that's honestly not good enough. They could decide not to sue a user of copilot if it produced MS code regardless of whether copilot produces infringing code in general. An indemnification for the customer in case of third-parties suing them over code produced by copilot is honestly the only way I could take Microsoft's position seriously.
- firstbabylonian 5y agoBoo hoo. Open source licences are a joke, GPL is a deranged dream. There's no stopping the train of the software industry, and businesses have no interest in upholding some hippie mantras from a simpler time about free software love. Their developers are too busy writing throwaway code to set up the next A/B test of a feature that won't exist three months from now: who cares about attributing every if statement their editor autocompletes to some random evangelist who authored it in the 90's. Let's get real.
- corty 5y agoWell, maybe. Until the likes of Oracle come along and sue the shit out of your nice little startup for a few lines of wrongly-attributed boilerplate. Licenses aren't enforced by most hippie coders due to lack of interest and money. But they sometimes are enforced by greedy big corporations without an interest in anything but lots of money.
- pabs3 5y agoConservancy enforce licenses in a principled way. They are currently working on an enforcement action in the IoT space: https://sfconservancy.org/copyleft-compliance/ https://sfconservancy.org/copyleft-compliance/ https://sfconservancy.org/copyleft-compliance/principles.html https://sfconservancy.org/copyleft-compliance/principles.htm... https://sfconservancy.org/copyleft-compliance/firmware-liberation.html https://sfconservancy.org/copyleft-compliance/firmware-liber...
- corty 5y agoYes, and it is nice that they are doing it. But they are limited by their manpower and financials. And they are not agressive enough imho, e.g. by avoiding litigation and extending courtesies like voluntary GPL2 extensions after termination for offenders. They should engage more in shock and awe. Compliance departments all over the industry should fear them, not laugh about them.
- pabs3 5y ago
- jrm4 5y agoSo I think the most useful analysis is to "first principles" this from a Microsoft point of view, and it's not too hard to see the likely endgame. It's something like: Having been unable to defeat free/open software through the courts and copyright, lets try it this way -- let's see if we can, without too many people noticing, gain control of free/open source through its biggest repository with "Copilot." We'll let just enough people who are not us use it in ways that we see fit, but also probably later on will fight against "scraping our data" to retain control (like we tried to do with LinkedIn.)