2 ms·
> Their goal/claim is that the language model will not retain copyrightable sequences. In case people are not aware, we know for a fact this is demonstrably fa
by jimlongton 4y ago
> Their goal/claim is that the language model will not retain copyrightable sequences.
In case people are not aware, we know for a fact this is demonstrably false. It may not even be possible to achieve this with existing models. People have replicated entire sections of GPL code (with comments) using CoPilot. This is true of other models, like image generation models which can return clearly recognisable images which were present in their training sets.
- Dylan16807 4y agoThe interesting question is how hard that is to fix in future versions.
- jeroenhd 4y agoAs far as I know, an AI spitting out training data has clearly been overfitted on its input. However, I think this may be intentional, as an AI that doesn't spit out the occasional bit of training data may not be delivering output of a high enough quality.