3 ms·
Well it got it wrong, so no?
by tdy721 4y ago
Well it got it wrong, so no?
- yccs27 4y agoLanguage models like ChatGPT seem to "remember" paragraphs of text in a highly compressed form which is not always fully accurate when reproduced - so a mistake does not tell us whether the text is from memory.
- freilanzer 4y agoLossy reconstruction of training data is still memorisation.