4 ms·
> They argue that ChatGPT's ability to produce detailed summaries of their works indicates their books were included in datasets used to train the technology.
by musicale 3y ago
> They argue that ChatGPT's ability to produce detailed summaries of their works indicates their books were included in datasets used to train the technology.
If ChatGPT can reliably answer "what happens on page (x) of book (y)?" that would provide fairly convincing evidence, as summaries or study notes on a random book are unlikely to be that detailed. Moreover, if this approach worked consistently, it would enable the entire book to be summarized - or even rewritten - page by page.
- penjelly 3y agonot sure i agree with your conclusion since LLMs can easily avoid mentioning the page even if they knew it. Though id also guess that the llm didnt ingest page numbers and just ingested books raw? Anyway i tried it. > im looking king for a quote in the book iRobot, what page is isaac asimovs the laws of robotics on ? provide the version of the book so as well so were clear ChatGPT I'm sorry, but as an AI text-based model, I don't have direct access to specific book editions or their page numbers. However, I can provide you with general information about Isaac Asimov's "I, Robot" and the Laws of Robotics. it doesnt know, but i also didnt coax it or jailbreak it to circumvent any avoidance
- CharlesW 3y ago> it doesnt know Correct, because it only knows the text, not the layout. It will tell you that it appears in Runaround, and that the Laws are "usually presented towards the beginning of the story, in the dialogue between the characters Powell and Donovan".
- musicale 3y agoAh interesting. That could be avoidance though. Guess it's useless for pseudo-copy protection schemes for some old games like "what's the first word in the third paragraph on page 17 of the game manual."
- penjelly 3y agofwiw ive asked it to summarize the first 5 chapters before, and it was able to do that. Just a high level breakdown