15 ms·
> If it is, as you claim, permissible to train the model (and allow users to generate code based on that model) on any code whatsoever and not be bound by any l
by josephcsible 4y ago
> If it is, as you claim, permissible to train the model (and allow users to generate code based on that model) on any code whatsoever and not be bound by any licensing terms, why did you choose to only train Copilot's model on FOSS? For example, why are your Microsoft Windows and Office codebases not in your training set?
This is my favorite question about Copilot ever.
- JoshTriplett 4y agoNote that while Copilot is a major motivator for this effort, it isn't the only one; there's a pile of other reasons listed at https://sfconservancy.org/GiveUpGitHub/ https://sfconservancy.org/GiveUpGitHub/ . GitHub and its lock-in has been a problem for a long time, and this is just the most recent problem.
- lumost 4y agoI’d be curious if you could get copilot to cough up its own answer on its legality.
- mr_toad 4y ago> why are your Microsoft Windows and Office codebases not in your training set? This is my favorite question about Copilot ever. While GitHub might have a license to use that code to train the model, it’s debatable what license applies to the output of the model, and what users of the model can do with it. It’s possible for an AI to reproduce something so close to the original that it would be considered an infringement on the original work.
- ipaddr 4y agoMy favorite answer is: if you included Microsoft source code the quality of suggestions drops below viable product.
- codefreeordie 4y agoThis is a funny and flippant answer, but is also nonsense.
- iudqnolq 4y agoIt is however plausible that the code is only "good" given internal considerations. Microsoft has a specific internal coding styles designed to work with internal tools
- alexklarjr 4y agoI called it microsoft DNA. The way they do stuff is inhuman alien logic without any compassion or remorse (like all 10k+ their windows apis, or dontnet, or way they add features and handle support ).
- omegalulw 4y agoDo you have any evidence for this?
- alexklarjr 4y agoI don’t have windows 10 or 11, sorry.
- josephcsible 4y agoThe reasons that Windows is awful have nothing to do with code quality. Windows is awful because of intentional choices Microsoft made (e.g., bloatware that gets reinstalled with every update, mandatory Microsoft accounts, and mandatory telemetry).
- NicoJuicy 4y agoSupport for legacy features is always #1, code-wise
- mmis1000 4y agoThe default of windows already do compatibility in some crazy way. And the compatibility mode lies to the program about system version or even fake old bugs so program relies on bug will run. And I'd imagine. To make this work, ms would need tons of most shitty code you'd imagine in the source o fake those behaviors.
- alexklarjr 4y agoTheir code were awful about 30 years before that.
- buchoo 4y agoWas it? I recall the kuro5hin analysis of the leaked Windows 2000 source code[0] that said: >there is nothing really surprising in this leak. Microsoft does not steal open-source code. Their older code is flaky, their modern code excellent. Their programmers are skilled and enthusiastic. Problems are generally due to a trade-off of current quality against vast hardware, software and backward compatibility. [0] https://web.archive.org/web/20040401115821/http://www.kuro5hin.org/story/2004/2/15/71552/7795 https://web.archive.org/web/20040401115821/http://www.kuro5h...
- samatman 4y ago30 years ago was 1992. That's the older flaky code they're referring to in the quote.
- wilde 4y agoThe boring answer is probably something along the lines of “copilot was trained by employees of OpenAI who aren’t technically MS employees”. When I worked at MS you had to jump through all sorts of hoops to get access to code from other orgs. I can’t imagine what BS you’d need to do to give access to a vendor.
- jlkuester7 4y ago> you had to jump through all sorts of hoops to get access to code from other orgs This may be the dumbest move from M$ that I have read on this thread! Sure, companies need to protect their private IP, but this really feels like creating unnecessary friction for no good reason...
- google234123 4y agoOnce you are large enough, you realize there will be some people joining a company with bad intentions?
- ratww 4y ago> creating unnecessary friction for no good reason That's definitely something that most large corporations do.
- popinman322 4y agoAt least a year ago in Azure that wasn't true; everyone had access to nearly every internal service's code (+the windows kernel). Though there were some exceptions (the Teams team didn't want to share their source at all for whatever reason).
- plonk 4y ago> the Teams team didn't want to share their source at all for whatever reason Because it probably mines one bitcoin block every time you click on something. No sane codebase could possibly be so abysmally slow.
- innocentoldguy 4y agoHaving worked on Windows code, I’m pretty sure you don’t want your Copilot-generated code tainted with all that cruft.
- Vetch 4y agoGithub's position doesn't appear to offer any advantage with regards to Copilot's creation. OpenAI Codex (which copilot grew out of IIRC), Amazon and Salesforce versions of Copilot exist. Huggingface Bloom was trained on a sizeable amount of public code. Tab9, now behind, was one of the earliest to combine public code repositories with Deep learning for smarter autocomplete. The data requirements for Transformer scaling mean any and all public facing repositories will be assimilated, whether Github, Gitlab, Stackoverflow or so on. Wish more energy was spent on how to fund pretrained models that will also run efficiently on CPUs, fine-tuneable to one's language and local environment. Removing reliance on cloud services. Curious about people's opinions on Dall-E 2 or Google Image-gen, which parallel pretty much the same thing with Renders, Illustrations and Paintings, or upcoming models doing the same for voice acting and music. Coders seem more excited about the potential of those tools.
- leereeves 4y agoIs anyone using Dall-E, Imagen, or any other generative model for art to create commercial products? If so, they're probably also concerned about copyright issues. CoPilot is being offered for widespread commercial use, so it's held to a higher standard. Respecting copyright is much more important when you're building a business and not just sharing fun AI art on social media.
- ShamelessC 4y agoOpenAI currently offers a GPT-3 API and an invite only DALLE2 API. Both of these are commercial products trained on web datasets and can output collisions with the training set. They have effectively zero concerns about copyright due to it being covered under fair use and OpenAI having copyright on all outputs (in the case of DALLE2).
- comex 4y agoPerhaps because there is a (small) risk of leaking confidential information through its output. But that's not as damning as it sounds. First, we know Copilot, if given the right prompt and told to autocomplete repeatedly without any manual input, can regurgitate bits of code seen many times in many different repositories, like the famous Quake fast inverse square root function and the text of licenses. That doesn't mean it does so under normal prompts and normal use. Perhaps it does sometimes, and that would be a real concern. But any regurgitation that isn't under normal use, which only happens if the user is trying to make Copilot regurgitate, is not a problem when it comes to copyright violations of open source code (since anyone trying to violate an open source license can do so much more easily without using Copilot), yet it may still be a problem when it comes to leaking confidential information. Second, whether something is a copyright violation and whether it risks leaking confidential information are somewhat orthogonal. A copyright violation usually requires at least several lines of code, and more if the copying is not verbatim, or if the code is just a series of function calls which must be written near-verbatim in order to use an API. On the other hand, `const char PRIVATE_KEY[] = ` could hypothetically complete to something dangerous in just one line of code. That said, it almost certainly wouldn't, since even if a private key was stored in source code in the first place (obviously it shouldn't be), it probably wouldn't be repeated enough to be memorized by the model. Yet… …third, the risk tolerances are different. If, to use completely made-up numbers, 0.1% of Copilot users commit minor copyright violations and 0.001% commit major ones, that's probably not a big deal considering how many copyright violations are committed by hand – sometimes intentionally, mostly unintentionally. (When it comes to unintentional ones, consider: Did you know that if you copy snippets from Stack Overflow, you're supposed to include attribution even in any binary packages you distribute, and also the resulting code is incompatible with several versions of the GPL? Did you know that if you distribute binaries of code written in Rust, you need to include a copy of the standard library's license?) But when it comes to leaking confidential information, even one user getting it would be somewhat bad (though admittedly Microsoft does distribute much of their source code privately to some parties), and taking even a small risk would be a questionable decision when there is a ready alternative.
- natefinch 4y agoFWIW, there are some (admittedly fairly naive) checks to prevent PII and other sensitive info from being suggested to users. Copilot looks for things like ssh keys, social security numbers, email addresses, etc, and removes them from the suggestions that get sent down to the client. There's also a setting at https://github.com/settings/copilot https://github.com/settings/copilot (link only works if you've signed up for copilot) that will check any suggestion on the server against hashes of the training set, and block anything that exactly duplicates code in the training set (with a minimum length, so very common code doesn't get completely blocked). Users must choose the value for this setting when they sign up for copilot. source: I work on copilot at github
- noasaservice 4y agoAccording to their logic, if I train a model using stolen Windows source code, it's fair use. Just because they use FLOSS licenses, does not allow them to evade things like Affero GPL3. And, to that end, if they are using Affero, I want the source to the whole copilot infrastructure -or- proof they used no AGPL3 code anywhere.
- deleted 4y ago[deleted]
- _Algernon_ 4y agoI mean the answer to that question is obvious: they're not under any obligation to include their own code in the training data. Why would they? A better question would be whether they would take legal action against a competitor that creates a copilot equivalent and publicly states that they trained it on leaked, proprietary M$ source code. That would actually be an example of hypocrisy.
- DJHenk 4y ago> They're not under any obligation to include their own code in the training data. Why would they? Because these models work better with more data and presumably this a lot of high quality data that they already have lying around anyway? Because there no downside according to their own reasoning? Because it would shut up a lot of these criticisms right away? Because marketing would be so much easier with that kind of dogfooding? In short: because according to their own story there would be only upsides, no downsides.
- naikrovek 4y agoI want to know what stuff you guys are putting in public GitHub FOSS repos that you don't want replicated in any way... I also want to know why people think their code is so special that no one else could have ever come up with it independently. Each and every opponent of Copilot is the best developer ever, I guess? That said, I don't understand the choice to use GPL for any reason, so maybe I'm not equipped to understand the arguments against Copilot. Forcing your code to be open forever isn't freedom, it's the omission of freedom. Someone using your (for example) MIT-licensed code in a closed-source commercial software project doesn't "un-free" the code you released; your code is still exactly as open and as available as it was before, and zero freedoms were lost by anyone.
- bonzini 4y agoForcing your code to be open forever is guaranteeing freedom of all users of my code, both direct and indirect. Developers don't need to have any more freedoms than other users.
- naikrovek 4y ago> Forcing your code to be open forever is guaranteeing freedom of all users of [your] code No, that’s forcing restriction on all users of your code. Usage restriction is the opposite of freedom… Forcing all of your code to be GPL is like saying “I am on a diet, so now I will force everyone else be on the same diet. Freedom!”
- TheDong 4y agoWhat you are pointing out is similar to "the paradox of tolerance" https://en.wikipedia.org/wiki/Paradox_of_tolerance https://en.wikipedia.org/wiki/Paradox_of_tolerance By analogy, there is a law against me putting handcuffs on another, and in fact the police would stop me from doing so. Did the police protect freedom? Aren't they restricting me from handcuffing others? In a similar manner, under the MIT I can restrict my users from modifying and compiling my source code. Is a license that means I have to let my users modify code restricting freedom? Isn't it ensuring freedom of others, in the same way that making laws of "you shall not handcuff others for no reason" is ensuring freedom of others?