3 ms·
To me AI code generators are the equivalent of crypto tumblers or mixers for digital coins. You can pretend all you want that the output is 'clean' but we all k
by jacquesm 4y ago
To me AI code generators are the equivalent of crypto tumblers or mixers for digital coins. You can pretend all you want that the output is 'clean' but we all know it came from somewhere else and wasn't actually generated by the software, just endless little snippets that other people made.
- deleted 4y ago[deleted]
- remus 4y agoI don't think that's entirely true. When I've tested codepilot it also knows something about the context in which it's working, so it can use relevant variable names in it's suggestions. To me that's a step beyond rote regurgitation of other code.
- jacquesm 4y agoThat may be so, but the process is automated and copyright law has something to say about mechanical transformation. As an example: if I take a piece of code you wrote and substitute all of the identifiers that does not create an original work.
- system2 4y agoChatGPT output is very clean and precise especially when variables provided in detail. I doubt you can trace it back if you make the prompt very elaborate.
- jacquesm 4y agoWhy can't you trace it back? Remove all the input, fill the model with noise. Prompt all you want it will produce just noise. Train the model on your chosen input text. Suddenly it starts to provide 'clean and precise text'. Absent an argument that we're looking at AGI I see no other possible conclusion than that this is a mechanical transformation of two inputs (yours + the training data) into some output. What happens inside the box is irrelevant, that's just implementation details of the mechanism. If you build your mechanism in such a way that you can't trace it yourself that doesn't mean that you get to claim the output as an original work.
- system2 4y agoWhat kind of platform can detect what variables or instructions I added? It can be very difficult to reverse engineer the prompt from the output.
- jacquesm 4y agoThat's not the problem though. The onus would be on you to prove that your machine generated the output and that it wasn't based on the training data but just on your input. Otherwise the generated work isn't yours.
- system2 4y agoThat's the moral aspect of the problem. First thing that I am concerned is that the search engines will be flooded by the bots creating ai content and engines won't have a way to identify it.
- jacquesm 4y agoSure, but that's not a copyright issue, that's just the problem of the web in general: by measuring something (ranking the importance of a page) you've introduced an element that can be gamed and whatever means people can use to game it they will use. But copyright is an entirely different kettle of fish and it is very well possible that Microsoft/GitHub will be able to do an end run around copyright but I don't think they've really thought through what the consequences of that will be. Essentially they are saying 'if you have access to a bunch of source code you are free to slap new terms and conditions on the hosting of that code and then you can use it to train your models, even without active consent of the copyright holders'. In that world Microsoft stands a lot to lose. Much more than your average GitHub repository owner. So this was a terrible mistake on their part.
- godelski 4y agoThis is definitely not true. In theory a generator could reproduce a distribution of data that includes more than the data it was able to sample from. For example, you could create the distribution of all possible faces from a subset of sample faces. That means you could create the faces of people who do not yet exist. Now good luck getting that perfect generator (black swans, bias, etc), but it would be naive to believe that they (well... that there can be no generator that) are just copy input data and mashing them together. At least if you're going to believe that that also isn't happening in the real world, but then what's the difference?