3 ms·
> Leaving GitHub wont change that, OpenAI is training its models on every bit of code they can have, sourcehut, codeberg etc. If its public, they will train on
by lelanthran 4y ago
> Leaving GitHub wont change that, OpenAI is training its models on every bit of code they can have, sourcehut, codeberg etc. If its public, they will train on it.
Not every bit of code, they are respecting proprietary licenses.
When MS puts the code for Windows, Office, Azure and everything else in front of ChatGPT, Copilot, whatever other AI learning model they have, then perhaps they have a leg to stand on.
Otherwise, they're just being hypocritical to claim that no injury is being done by using code for training, because they are refusing to train on any of their code.
Right now it just looks like they are ripping off open source licenses without meeting the terms of the license.
https://www.lelanthran.com/chap7/content.html https://www.lelanthran.com/chap7/content.html
- Ajedi32 4y agoAFAIK that has nothing to do with the license, it has to do with whether the code is public. You don't want the AI accidentally revealing proprietary non-public information (e.g. imagine someone had a secret API key in a private repo and copilot leaked it; that'd be a huge incident), so you don't train it on that information, regardless of what it's licensed under. You could make a similar argument for not training on GPL code, but it's a lot easier to programmatically determine whether or not code is public than it is to programmatically determine what it's licensed under, particularly when you're training on massive amounts of unlabeled data. Not to mention it's way easier to delete an accidentally-added snippet of GPL code from a codebase than it is to "unleak" company secrets after they've been publicly revealed.
- AlexandrB 4y ago> Not to mention it's way easier to delete an accidentally-added snippet of GPL code from a codebase than it is to "unleak" company secrets after they've been publicly revealed. How often do you think anyone will notice that some part of a proprietary codebase is copied substantially from GPL code? I think it's going to be very rare and a lot of this code will fly under the radar. The GPL was always a kind of legal jiu-jitsu, turning copyright against itself and allowing non-commercial entities to protect themselves from uncompensated exploitation. Models like copilot, if they're legal, upend the status quo tremendously. Even though your code isn't (always) used directly, a commercial entity like Microsoft will slurp it up and sell the resulting model back to you for $9.99/mo.