4 ms·
I’m Not Sure That (If?) GitHub Copilot Is a Problem
- modshatereality 4y agoOf course it's a problem, this is a way for microsoft (and it's customers) to side-step it's (their) competitors software licenses (contracts).
- satvikpendem 4y agoNote that the author, Michael Weinberg, is "Executive Director of NYU Law School's Engelberg Center for Innovation Law and Policy" as well as "President of the Board of the Open Source Hardware Association." He is an actual lawyer (who also knows about open source) unlike most people I see who comment online about Copilot, and whether something is fair use or not. I'm not going to comment on whether he's right or wrong, lest I fall into the same trap I just outlined, as I'm also not a lawyer, but, unrelated to this particular case, I see this kind of thing often on the internet (as well as real life), where people who have no knowledge or experience about a particular topic go on to comment as if they were an authority on the subject. I see it on /r/legaladvice and other subreddits, and on HN here in many cases, including on certain lab leak theories. It reminds me of the Gell-Man Amnesia Effect.
- astorsnk 4y agoMost of the comments I've seen on HN have been personal opinions or legal questions rather than legal opinions. Copilot may be 100% legal - that doesn't make it 100% ethical (depending on your personal ethics).
- ipaddr 4y agoEating bananas may not be ethical. That is very subjective.
- amelius 4y agoOf course it is subjective. There are at least two parties involved. One party wants this. The other party wants that.
- xboxnolifes 4y agoThe existence of every law begins with something subjective. Just because something isn't illegal doesn't mean it shouldn't be. Just because something is illegal doesn't mean it should be.
- UncleMeat 4y agoA huge portion of the comments are specifically about licenses and Copilot as license laundering to access GPLed code.
- janalsncm 4y agoI see this kind of fallacy all of the time. People LOVE to smuggle in what (they think) the law says on a moral question, ignoring the fact that 1) legal and moral aren’t the same thing 2) laws change over time 3) laws differ from place to place and 4) when talking about what the law should be, what the law currently says is entirely irrelevant. https://en.m.wikipedia.org/wiki/Appeal_to_the_law https://en.m.wikipedia.org/wiki/Appeal_to_the_law
- dalmo3 4y ago> people who have no knowledge or experience about a particular topic go on to comment as if they were affected by the subject FTFY
- jeltz 4y agoAnd that includes the author of this blog post. He does not seem to understand GitHub and how code ens up there.
- jeltz 4y agoMeh, this blog post is mostly just random ramblings and no legal analysis. For example the ToS obviously does not save Microsoft. The code they have trained Copilot on includes code written by authors who did not upload anything to GitHub themselves. Some of them may even have died before GitHub was founded.
- philote 4y agoHe may understand law well, but not code and AI. I didn't see the author address that licensed code could be spit out, in large unedited chunks, by Copilot. I would expect that to be brought up as well as discussion about how much code needs to be copied to become a license violation. Also, while most of the article was pretty digestible by a layman, he only mentioned "fair use" but didn't give a definition of it. And while something may be "fair use" for copilot, what about the user who then uses that code? His comparison to Google getting sued for scanning books to provide search didn't really fit well.
- kcb 4y agoLicensed unedited code can be spit out by a google search too.
- SahAssar 4y agoLiterally nobody claims that googled code can be used without agreement from the author.
- satvikpendem 4y agoGoogle Books also shows verbatim passages of text, sometimes entire pages much longer than what Copilot typically emits, yet Google Books was deemed to be fair use by the courts. I've edited my comment above to show that he's also president of the Open Source Hardware Association so I think he knows how open source code works.
- nequo 4y agoGoogle Books tells you what book the passage comes from so you can give proper attribution if you use it. GitHub Copilot doesn't do that.
- sdenton4 4y agoThe examples I've seen of this involve basically writing the attribution in the prompt, making the question moot...
- saurik 4y agoFWIW, I would claim that the lawyer--who admits to not being a software developer and is thereby in some sense also speaking out of place (as is almost everyone, which to me undermines your concern a bit ;P)--to me entirely misunderstands the reason why people try to use these licenses in the first place.
- satvikpendem 4y agoSure, however I would trust a lawyer's words on legal matters (which the article he references is making it out to be, not merely a technical software engineering matter) more than non-lawyers, just as I'd trust a doctor's words than a non-doctor's on medical matters.
- saurik 4y agoBut the issue at hand usually isn't "is Copilot legal under current law" but "should it be"; the article even admits this, touching on the legality but merely on its way to eventually tackle the question of whether it is "a problem", something that isn't (to me) much of a question of law, but instead either a question of ethics or, maybe (if one tries to be completely dispassionate on the matter), economics (which seems to be the approach used in the analysis by this lawyer).
- deleted 4y ago[deleted]
- nqfalter 4y agoGreat. He has a president title (presumably with a salary) on the backs of thousands of people who actually write hundreds of thousands of lines of open source for free. I don't care at all about his view on ethics, in this case I'd prefer a Disney lawyer.
- amelius 4y agoOk, he is a lawyer so he knows what the law currently is. And he should also know that the law is always lagging behind, especially in technology. However, being a lawyer doesn't mean that you know how the law should work.
- croes 4y ago>At this point, Copilot strikes me as a tool that replaces googling for stack overflow answers Didn't think about the impact on sites like Stack Overflow. Seems more like a disadvantage of Copilot because it reduces interaction on Stack Overflow.
- artificialLimbs 4y agoCentralizing knowledge into a proprietary paid tool rather than an open access, ad driven site is going to create some loss.
- jchanimal 4y agoAs a StackOverflow googler myself, I think this analysis is about right. However I doubt making it easier to stand on the shoulders of giants will reduce community. It will just make it easier for new people to contribute ideas.
- awinter-py 4y ago> At this point, Copilot strikes me as a tool that replaces googling for stack overflow answers I feel like there are 3 categories in that idea: 1. mapping local vars to function call (and related, how to feed the output of a function into another function from the same library) 2. coming up with a minimal runnable example of a given function 3. semantic search for which function to use for a task docs shipped with a library often fail at this, but there are things languages can add to get better at all 3. In particular, syntax for automatically consuming local vars in function calls, and in the package manager, extracting function comments and offering global indexes.
- harryvederci 4y ago> At this point, Copilot strikes me as a tool that replaces googling for stack overflow answers. I've never seen anyone put a license on code they post on stack overflow, so I imagine you agree to release code in your answers under a permissive license (MIT, e.g.) when signing up on stack overflow. On github however, it's common to put a "LICENSE" file in a repository. Github even automatically shows you what license it is when its content is a known, widely used license. They do that automatically. But somehow, with all their fancy AI magic, it's too hard for github's employees to use the same automated licensing code to decide whether or not they should share licensed code. They could also slap on a comment saying: "WARNING: this code is licensed under the <license name> license." They could even expand that, saying: "Your repository has the <license name> license, so in order to use this code you'd have to change your license." Github could fix this issue with a hash-map and an if-statement. By not doing so they're willfully letting people commit copyright infringement, and disrespecting everyones intelligence in the process.
- glandium 4y agoIronically, everything on SA is in a version of CC-BY-SA https://stackoverflow.com/help/licensing https://stackoverflow.com/help/licensing and compatibility with most licenses is doubtful, but I don't think most people care when they copy/paste from there. Not even considering license compatibility, how many people follow its attribution clause?
- im3w1l 4y agohttps://stackoverflow.com/help/licensing https://stackoverflow.com/help/licensing > Content contributed before 2011-04-08 (UTC) is distributed under the terms of CC BY-SA 2.5. > Content contributed from 2011-04-08 up to but not including 2018-05-02 (UTC) is distributed under the terms of CC BY-SA 3.0. > Content contributed on or after 2018-05-02 (UTC) is distributed under the terms of CC BY-SA 4.0. Basically it says you may share the code and you may use it for any purpose, but you must give attribution and you must license your derived work under the same license. If you don't do those things then you are basically relying on some kind of fair use or "this is too trivial to be copyrightable". But yeah, there really is a license.
- phire 4y agoI've been using copilot for a few months. The advertised usecase where you describe a function with a comment then it spits out a whole function is (in my experience) pretty bullshit most of the time. It's not good enough to produce good results enough of the time, so you have to always triple check what it spat out anyway. I find it's useally easier to actually write (or start writing) the function myself. But where copilot really shines (in my experience) is as a really advanced auto-complete. I just write my code as normal and there is a actually a pretty decent chance copilot will spit out the next few lines of what I was planning to write, allowing me to write code faster. When you are using copilot in this way, it's near impossible for it to do copyright infringement. It's generally only outputting a few lines, and I'm only accepting them when it's reasonably close to what I was planning to write anyway. It's really good at generating boilerplate code. Or code that interacts with API functions. Where it really shines is converting unformatted data into code. For example, You can copy/paste a list of words into a comment, then start writing the code to initialize an array with those words, and it will very quickly cotton on to what you want to do and complete the whole transformation for you. Sure, the same thing could have been done with a clever macro, or some vim commands I don't know. But I just find working with copilot to be more intuitive. And it can do more advanced transformations too. When I'm using copilot in this way, it becomes pretty clear that copilot is not simple a code search engine, or a fancy interface Infront of stack overflow. It's pretty clear that it's outputting code that couldn't be found in any database. I get a little annoyed when everyone (including githubs own marketing) focused on the "whole function from comment" usecase. Not only does it paint it in a bad light from a copyright perspective, but (IMO) it's really not it's best or even most technically impressive mode.
- PaulDavisThe1st 4y ago> there is a actually a pretty decent chance copilot will spit out the next few lines of what I was planning to write, which suggest, loosely, that copilot has been trained on some of your code.
- phire 4y agoI guarantee it has been trained on some of my past code. But it's not like I spend my life simply writing my past code again, and it hasn't been trained on the code I'm about to write, because it doesn't exist yet. Besides, is that not the selling point of copilot? It's been trained on everyone's code, so it should be able to predict for everyone (for some definitions of everyone)
- jmcphers 4y ago> At this point, Copilot strikes me as a tool that replaces googling for stack overflow answers This matches with my experience. I have never used Copilot to generate a large body of code or even anything more than a few trivially inspectable lines. To name a very specific example, earlier this morning I was working on a VS Code extension and needed to figure out how to get it to prompt the user to select a file. I started typing out a Google search, but realized that Copilot might already know what to do. So I entered a comment like the following: // Prompt the user to select a file using VS Code's extension API And, like magic, Copilot generated the correct incantation, including auto filling the parameters to the API call to single select a file (vs multi select or directory select). It saved me probably four or five minutes of searching the web and figuring out the right API call and options to get the behavior I wanted. To me, Copilot's value is as this sort of labor-saving device. It can indeed be induced to generate larger amounts of code, much of it questionable, but the tool can be a huge time-saver when used responsibly.
- mistrial9 4y agoI feel like an entire generation of coders now have experienced "reading requirements and checking manuals / StackOverflow to fill them" and no idea at all about "studying a problem space and designing software to fit there" .. Early literature was filled with observations of coders as engineers plus computer language users. Not so much today, now it is "who can read the newest AWS service manuals and write microservices to respond to it" .. this conversation about Copilot is constantly in a disconnect between form generators + web client writers + AWS jockeys who want pro-forma solutions cheaper, and domain experts or science implementors. An imperfect analogy comes to mind between textbook authors, and people who write small commercial things under someone's direction. The wailing and outcry here is to protect skilled work from being raided (like a crucial piece of code that solves something difficult or special), or the income of people who do skilled work (authors that are committers to non-trivial libraries), not so much about low-cost javascript writers or in-house forms generation code for business processes.
- w10-1 4y agoThe post summarizes what others have said. It does not independently assess or define fair use or the github terms of service. As for "actual lawyer": The linked-in profile of the author includes no work for any law firm or on relevant case law; it has some public-interest and open-source advocacy and his own "firm" consulting with startups, and some legal work for a startup as GC. It's good that he's been interested in this domain, but his work is not obviously validated. It may be wise for him not to attempt a legal assessment, or for readers not to grant him too much deference. With no disrepect intended to the author, I would encourage readers to make their own assessments before accepting Copilot as benign. I appreciate satvikpendem's caution about non-lawyers, but both discussion and the law are probably best served not by deferring entirely to lawyers. The law should make sense, and non-lawyers should be able to use it to reason about the legality of practices, at least to validate legal opinions. Much of what matters in law is the process and posture, especially establishing who has the burden of action and proof. With Github copilot, Microsoft is daring (forcing?) people to invest a lot of money adjudicating novel issues for uncertain damages to recover on intangible benefits like community. If Microsoft/Github want to establish favorable case law, it's best to find weak opponents with few incentives. Even if there were a large company with code copied from Github, they'd have to be willing to anger Microsoft (who could likely fork their business on a whim). The article setting the expectation that there's no problem or harm only helps Microsoft. In most cases, the executive director of any nonprofit, even when tied to the university, is largely responsible for fund-raising, and generally pursues the goals of the funders, or telegraphs opinions likely to raise funds. Better sources would be tenured professors with publication histories on point, or practitioners who have adjudicated some of the case law. Corporate lawyers working in the domain have the expertise, but likely not the incentives. Fair use, per <https://fairuse.stanford.edu/overview/fair-use/what-is-fair-use/ https://fairuse.stanford.edu/overview/fair-use/what-is-fair-...>: "limited and “transformative” purpose, such as to comment upon, criticize, or parody a copyrighted work. [...] Most fair use analysis falls into two categories: (1) commentary and criticism, or (2) parody" Copilot is decidedly not commentary, criticism, or parody. It's extracting code in whole and remixing, just as Google does in extracting text to its search listings. The difference is that there's a benefit to the listed site leading it to permit this use. Copilot offers zero benefit, and may indeed reduce interest in the source code. Also remember fair use is an exception to copyright, a defense. The burden is on the infringer to establish the exception in case law. To date, no one has.
- pcj-github 4y agoPersonally I don't think it matters if Copilot spits out large near-complete functions or smaller one-line snippets, or if you find it useful or not. The fact is that it consumes a large corpus of work and launders it in way that removes all attribution should be a big no. That goes against the entire spirit of copyright law. It must be opt-in, or make Microsoft wait 95 years to incorporate code in public repos for their for-profit enterprise.