4 ms·
That's not how machine learning works. They don't "perfectly memorize" anything. They do learn much quicker than humans, of course, but that alone doesn't seem
by tananaev 3y ago
That's not how machine learning works. They don't "perfectly memorize" anything. They do learn much quicker than humans, of course, but that alone doesn't seem like a good argument.
- skepticATX 3y agoThey do not perfectly memorize but they can spit out entire chapters of books word for word.
- nickthegreek 3y agoI've never heard or seen this unless a model is way overtrained. Could you provide an example?
- gkbrk 3y agoIs GPT3.5 way overtrained? Because it can regurgitate a ton of text verbatim from books. https://ibb.co/album/sJBB11 https://ibb.co/album/sJBB11
- nickthegreek 3y agowhat am I looking at? Do you have the prompts that were used?
- gkbrk 3y agoYou are looking at a Large Language Model (specifically GPT3.5) output full paragraphs from a book it was trained on. The prompt is the first 13 words of the book, shown with a white background in the first screenshot. The words with green background are the LLM outputs. The second screenshot is a diff that compares the LLM output with the original book.
- nickthegreek 3y agoWhat book? I just want to verify your statements. I don’t take 2 cropped screenshots on an image site as evidence to be frank.
- gkbrk 3y agoFrankenstein. You might argue that it is a public domain book, but it demonstrates that these LLMs can and do memorize books. It also works with Harry Potter, but the API behaves weirdly and after producing correct output in the beginning really quickly, suddenly hangs. You can continue generating the correct words by doing more API calls, but it only does a few words at a time before stopping. It clearly knows the right content, but doesn't want to send it all at once. I think there is some output filtering for "big" authors and stuff that is too famous that they filter in order to avoid getting sued. I wrote more details about the weird Harry Potter behaviour here: https://news.ycombinator.com/item?id=37614697 https://news.ycombinator.com/item?id=37614697
- beej71 3y agoThe could do, but with enough input the odds of that happening are very remote, is my understanding. And just because something could do something doesn't make it a violation.