3 ms·
LLMs can regurgitate almost all of the Harry Potter books, among others [0]. Clearly, these models can actually regurgitate large amounts of their training dat
by lunar_mycroft 9mo ago
LLMs can regurgitate almost all of the Harry Potter books, among others [0]. Clearly, these models can actually regurgitate large amounts of their training data, and reconstructing any gaps would be a lot less impressive than implementing the project truly from scratch.
(I'm not claiming this is what actually happened here, just pointing out that memorization is a lot more plausible/significant than you say)
[0] https://www.theregister.com/2026/01/09/boffins_probe_commercial_ai_models/ https://www.theregister.com/2026/01/09/boffins_probe_commerc...
- StilesCrisis 9mo agoThe training data doesn't contain a Rust based C compiler that can build Linux, though.