3 ms·
This underestimates how much of the Internet is actually compressed into and is an integral part of the model's weights. Gemini 2.5 can recite the first Harry P
by obirunda 8mo ago
This underestimates how much of the Internet is actually compressed into and is an integral part of the model's weights. Gemini 2.5 can recite the first Harry Potter book verbatim for over 75% of the book.
- NiloCK 8mo agoI'm getting astrology when I search for this. Any links on this?
- f33d5173 8mo agoIirc it's not quite true. 75% of the book is more likely to appear than you would expect by chance if prompted with the prior tokens. This suggests that it has the book encoded in its weights, but you can't actually recover it by saying "recite harry potter for me".
- jdminhbg 8mo agoDo you happen to know, is that because it can’t recite Harry Potter, or because it’s been instructed not to recite Harry Potter?
- jazzyjackson 8mo agoIt's a matter of token likelihood... as a continuation, the rest of chapter one is highly likely to follow the first paragraph. The full text of Chapter One is not the only/likeliest possible response to "recite chapter one of harry potter for me"
- jamesfinlayson 8mo agoInstructed not to was my understanding.
- obirunda 8mo agohttps://arxiv.org/abs/2601.02671?hl=en-US https://arxiv.org/abs/2601.02671?hl=en-US