3 ms·
LLMs are good at memorization, so yeah, if any included personal data I think you'd be able to get it to print it. (As an example, ChatGPT and Bard can both quo
by astrange 3y ago
LLMs are good at memorization, so yeah, if any included personal data I think you'd be able to get it to print it. (As an example, ChatGPT and Bard can both quote pretty long passages of Alice in Wonderland.)
There aren't any techniques I know of to prevent it either; when training an image model the recommendation is to dedupe the input so nothing is weighted over anything else, but that's not an absolute defense.
- yreg 3y agoAlice is many times in the dataset.