Frankenstein. You might argue that it is a public domain book, but it demonstrates that these LLMs can and do memorize books. It also works with Harry Potter,

Frankenstein. You might argue that it is a public domain book, but it demonstrates that these LLMs can and do memorize books. It also works with Harry Potter, but the API behaves weirdly and after producing correct output in the beginning really quickly, suddenly hangs. You can continue generating the correct words by doing more API calls, but it only does a few words at a time before stopping. It clearly knows the right content, but doesn't want to send it all at once. I think there is some output filtering for "big" authors and stuff that is too famous that they filter in order to avoid getting sued. I wrote more details about the weird Harry Potter behaviour here: https://news.ycombinator.com/item?id=37614697 https://news.ycombinator.com/item?id=37614697