3 ms·
> GPT models are known for memorizing their training data Hash each function, store the hashes as a blacklist. Then you can ask the model to regenerate the fun
by visarga 5y ago
> GPT models are known for memorizing their training data
Hash each function, store the hashes as a blacklist. Then you can ask the model to regenerate the function until it is copyright safe.
- ipsum2 5y agoWhat if it copies only a few lines, but not an entire function? Or the function name is different, but the code inside is the same?
- proteal 5y agoIf we could answer those questions definitively, we could also put lawyers out of a job. There’s always going to be a legal gray area around situations like this.
- ipsum2 5y agoMatching on the abstract syntax tree might be sufficient, but might be complex to implement.
- vlasev 5y agoYou can probably tokenize the names so they become irrelevant. You can ignore non-functional whitespace, so that code C remains. Maybe one can hash all the training data D such that hash(C) is in hash(D). Some sort of Bloom filter...