3 ms·
Very rough outcome: "Moreover, if such a request were granted, must the model be retrained from scratch? The fact that models can memorize and misuse an indivi
by grenoire 6y ago
Very rough outcome:
"Moreover, if such a request were granted, must the model be retrained from scratch? The fact that models can memorize and misuse an individual’s personal information certainly makes the case for data deletion and retraining more compelling."
Besides, how would one even know that their info was used in a training dataset, only if and when it's revealed in a generated excerpt?
- visarga 6y agoThey can try to prompt it. But I hope the GPT-3 authors have a hash list of ngrams in the training data to be able to avoid verbatim reproduction. I know they trained an offensive content detector model, they should also train a PII information detector to make sure it's being hashed.