4 ms·

How soon before someone will be able to make an online library which generates the original books using LLMs? Surely popular titles like Harry Potter may end up

by dom96 8mo ago

How soon before someone will be able to make an online library which generates the original books using LLMs? Surely popular titles like Harry Potter may end up so well represented in the training that we'll get the full books out of the LLM with a close to 100% accuracy?

anonymous908213 8mo ago
This is already possible for Harry Potter specifically. There was a study demonstrating that Sonnet 3.7, among other models tested, could reproduce the first Harry Potter book 95.8% verbatim[1]. [1] https://arxiv.org/abs/2601.02671 https://arxiv.org/abs/2601.02671
- dom96 8mo ago
  Thanks for linking! I've been thinking about trying something like this myself.
- deleted 8mo ago
  [deleted]
- Legend2440 8mo ago
  ...only if you deliberately attempt to extract it by repeatedly prompting it to complete fragments of the book. They had to do quite a bit of work to make this happen.
  - dom96 8mo ago
    so? It demonstrates that LLM models retain the copyrighted material in their weights. This is an important thing to consider about LLMs and shows that there need to be better protections for the creative industry.
    - fc417fc802 8mo ago
      Really? I retain plenty of copyrighted material in my head. What matters is the contexts in which I reproduce it (if any). A search index might also contain copyrighted material. As long as it's used for search queries as opposed to regurgitation there's no problem. Search indexes and LLMs are both clearly very beneficial tools to have access to.
      - themafia 8mo ago
        Reproduce it. Sit in a clean room and write it all out. Then go check your accuracy. I'm curious to see what it is.
        fc417fc802 8mo ago
        What does this (thought) experiment accomplish? That is, what point are you trying to make here? Since we're talking about an electronic system the search index example is the more directly relevant one. Anyone who wants to object to LLMs is going to need to take care to ensure consistency with his views on Google's search index.
        themafia 8mo ago
        I wasn't aware I could read 95% of Harry Potter through constructed queries using Google's search index. Can you demonstrate how I might do this? Also can you point out how copyright law changes because we're using an "electronic system" as opposed to an "analog system?"
        fc417fc802 8mo ago
        You could do the equivalent if they would let you. They don't. That's the point I was getting at. How the thing is used is what actually matters, not that it has "absorbed" copyrighted material. I never claimed any change in copyright law. Only that one analogy was more direct than the other for the purpose of the current discussion. You didn't answer my question. What point were you trying to make with your earlier reply?
    - PeterStuer 8mo ago
      "there need to be better protections for the creative industry" Why exactly?
cadamsdotcom 8mo ago
The word original is doing a lot of heavy lifting there! ;)
PeterStuer 8mo ago
You mean cp -r?

by dom96 8mo ago

anonymous908213 8mo ago

This is already possible for Harry Potter specifically. There was a study demonstrating that Sonnet 3.7, among other models tested, could reproduce the first Harry Potter book 95.8% verbatim[1]. [1] https://arxiv.org/abs/2601.02671 https://arxiv.org/abs/2601.02671

dom96 8mo ago
Thanks for linking! I've been thinking about trying something like this myself.
deleted 8mo ago
[deleted]
Legend2440 8mo ago
...only if you deliberately attempt to extract it by repeatedly prompting it to complete fragments of the book. They had to do quite a bit of work to make this happen.
- dom96 8mo ago
  so? It demonstrates that LLM models retain the copyrighted material in their weights. This is an important thing to consider about LLMs and shows that there need to be better protections for the creative industry.
  - fc417fc802 8mo ago
    Really? I retain plenty of copyrighted material in my head. What matters is the contexts in which I reproduce it (if any). A search index might also contain copyrighted material. As long as it's used for search queries as opposed to regurgitation there's no problem. Search indexes and LLMs are both clearly very beneficial tools to have access to.
    - themafia 8mo ago
      Reproduce it. Sit in a clean room and write it all out. Then go check your accuracy. I'm curious to see what it is.
      - fc417fc802 8mo ago
        What does this (thought) experiment accomplish? That is, what point are you trying to make here? Since we're talking about an electronic system the search index example is the more directly relevant one. Anyone who wants to object to LLMs is going to need to take care to ensure consistency with his views on Google's search index.
        themafia 8mo ago
        I wasn't aware I could read 95% of Harry Potter through constructed queries using Google's search index. Can you demonstrate how I might do this? Also can you point out how copyright law changes because we're using an "electronic system" as opposed to an "analog system?"
        fc417fc802 8mo ago
        You could do the equivalent if they would let you. They don't. That's the point I was getting at. How the thing is used is what actually matters, not that it has "absorbed" copyrighted material. I never claimed any change in copyright law. Only that one analogy was more direct than the other for the purpose of the current discussion. You didn't answer my question. What point were you trying to make with your earlier reply?
  - PeterStuer 8mo ago
    "there need to be better protections for the creative industry" Why exactly?

cadamsdotcom 8mo ago

The word original is doing a lot of heavy lifting there! ;)

PeterStuer 8mo ago

You mean cp -r?