5 ms·
> ChatGPT wrote most of what ended up in my production code. Some random person that's not going to get credited for their work wrote most of what ended up in
by avian 4y ago
> ChatGPT wrote most of what ended up in my production code.
Some random person that's not going to get credited for their work wrote most of what ended up in your production code.
- speedgoose 4y agoThat’s not how these models work though.
- simion314 4y agoIt depends, it happened for NN to spit out exact strings it had as input. I assume if the input for some particular stuff is low it will just spit it out, but if I am wrong and OpenAI, Microsoft or others have a mathematical proof that this will never happen I want to see it.
- speedgoose 4y agoYes we have seen a case of an old common and popular square root function that are returned verbatim by GitHub Copilot. Perhaps a case of overfitting since the code was present many many times in the training dataset, and even has a Wikipedia page. I haven’t seen more obvious examples since GitHub implemented a feature to prevent this from happening. I probably miss some tweets, but I assume it’s rare.
- williamcotton 4y agoCarmack’s fast inverse square is not subject to copyright in the first place.
- speedgoose 4y agoTrue. I think the comments and the coding style were from famous implementation from the 90s, which could be a copyright issue. The algorithm itself can by copied.
- manholio 4y agoIn the case of ChatGPT, you can be almost sure that if a non-trivial amount of code works in production then it's an unlicensed paraphrase of some human written code. It treats code (and everything else) like prose, hence the atrocious results in the original story. That does not mean other coding-optimized AI models won't be able to do much more, symbolic reasoning about the data, maintaining consistent variable and function names, understand libraries, respecting language constraints and invariants etc.
- speedgoose 4y agoI think ChatGPT switch to OpenAI codex when it writes code. It’s the same model that GitHub Copilot uses.
- williamcotton 4y agoThere’s no such thing as an “unlicensed paraphrase” of small snippets of utilitarian software, at least in US copyright law. You might have moral qualms with this but you won’t find much of any support from the court system.
- manholio 4y agoIt's clearly a derived work, since the apparatus that has produced the work (the AI model) can only function when supplied with copyrighted works - in fact it cannot exists without copious amounts of such works. If there is even a passing semblance between a source work and the output, such as, for example, similar code structure and different variable names, then you are legally fucked. I'm sure courts will clear this mess up really soon, and I'm betting money the rulings won't subscribe to the "it's mine now" mantra of the AI crowd.
- speedgoose 4y agoIs there any planned court case about the copyright fair use question ?
- williamcotton 4y ago
- bruce343434 4y agoI have no idea who laid down the road I use every day. Should their name be imprinted on it or something?
- practice9 4y agoShould've imprinted their names on your car to honor the history :D
- amelius 4y agoAt least they got paid for it.
- gerdesj 4y agohttps://en.wikipedia.org/wiki/Tarmacadam https://en.wikipedia.org/wiki/Tarmacadam
- jeffwass 4y agoI often wonder how different our technology tree would be without random but critical accidents like this. “In 1901, Edgar Purnell Hooley was walking in Denby, Derbyshire, when he noticed a smooth stretch of road close to an ironworks. He was informed that a barrel of tar had fallen onto the road and someone poured waste slag from the nearby furnaces to cover up the mess. Hooley noticed this unintentional resurfacing had solidified the road, and there was no rutting and no dust.”
- rebuilder 4y agoIf the law in your jurisdiction says so, yes.
- williamcotton 4y agoI’m get where you’re coming from but this has not been a convincing argument to the people who think that GPT is “stealing”. I think the only thing that will chip away at this sentiment at this point is when the US federal court system rules in favor of GPT/et al, which seems very likely.
- williamcotton 4y agoReally, someone out there wrote a spec for an API endpoint that updates a row in a Postgres database following our esoteric functional approach using our custom Either types and right down to the esoteric TS code formatting we used in that source file? What a coincidence!
- williamcotton 4y agoSo GPT is simultaneously taking credit for other people’s work and a threat to open source software but also incompetent and not a threat to anyone’s job?
- pclmulqdq 4y agoI think it's more like, "when it gets code correct, that code is probably stolen from someone."
- joxel 4y agoMaybe it’s because I’m not a CS person by trade, but the whole idea of stolen code is so stupid. There’s only a couple ways to write a function to do X, just because some asshole did it first and put it on GitHub, I’m stealing if I write the same function? Fuck off
- williamcotton 4y agoLuckily the court system has agreed with your sentiments since the 19th century so I wouldn’t worry too much!
- deleted 4y ago[deleted]
- throwaway371057 4y agoNever used it but this isn't exactly impossible, it's like having an essay due and you copy and paste chunks from the internet in a way that doesn't make sense as a whole and contains errors
- williamcotton 4y agoOnly it is nothing like this. What’s strange is how little effort it would take for you to use these tools. What I don’t find strange is that you feel confident having an opinion about this regardless of your lack of experience.
- angusturner 4y agoIf you haven’t seen it, I’d highly suggest looking at some of the recent research on in-context learning and reasoning in LLMs. It is becoming increasingly clear that there is a phase-change in behaviour when these models get large enough, such that they can solve new tasks outside of the training distribution. See work by Hattie Zhou or Laura Ruiz for example. It is clear to those following the research or using these models that they are not just copy-pasting… (Even if you can cherry pick examples were the LLM recalls highly occurring dataset items like fast square root or whatever).
- Kiro 4y agoThat's not how it works. You need to bait it really hard and push it into a corner for it to reproduce someone else's code, at which point you may just as well copypaste the code directly from the repo you're trying to lure it to reproduce.
- mensetmanusman 4y agoThat’s not how ChatGPT works…