3 ms·
Seems different if you can retrieve the text of a book by prompting the model with “Give me the text of X”. You can’t do that with the digits of pi.
by canjobear 3y ago
Seems different if you can retrieve the text of a book by prompting the model with “Give me the text of X”. You can’t do that with the digits of pi.
- chii 3y ago> You can’t do that with the digits of pi of course you can - pi contains all known combinations of digits.
- sp332 3y agoThis is suspected, but has not actually been proven.
- canjobear 3y agoIf you wanted to extract a specific text from pi, you'd have to find the location of the text within pi. Expressed as an integer, this location would amount to an encoding of the entire text and would probably be longer than the text itself. You could only find the location by explicitly searching for the exact text. The location address would effectively be a copy of the text. On the other hand, the "address" of a text within a memorizing large language model would just be the prompt "give me the text of X".
- chii 3y agoThe argument is largely a philosophical (and therefore, legal) one. The ease with which these "retrieval" operations can be done is irrelevant.