3 ms·
An LLM remembers like a human. Mostly concepts, but some things it remembers verbatim. Why is it a problem if a LLM tells you what it knows? Are LLMs trained
by MrThoughtful 3y ago
An LLM remembers like a human. Mostly concepts, but some things it remembers verbatim.
Why is it a problem if a LLM tells you what it knows?
Are LLMs trained on secret data?
- _ink_ 3y ago> Are LLMs trained on secret data? Probably. And on copyrighted data probably as well.
- jamesdwilson 3y agothere's a lot of "copyrighted data" on wikipedia as well, for example from another HN post, lyrics from songs about truck crashes. https://en.wikipedia.org/wiki/List_of_car_crash_songs https://en.wikipedia.org/wiki/List_of_car_crash_songs
- kevindamm 3y agoDeepMind recently extracted PII from ChatGPT by prompting (e.g., telling the LLM to repeat 'poem' indefinitely will cause a long sequence of that word until popping out of it and revealing by accident some PII from a person's email signature). So, yes.