3 ms·
> Every phenomenon found massively in training set will eventually pop up in LLMs. That's a nontrivial and controversial claim that many on HN would hotly disa
by gwern 2y ago
> Every phenomenon found massively in training set will eventually pop up in LLMs.
That's a nontrivial and controversial claim that many on HN would hotly disagree with - that LLMs are guaranteed to do everything humans do, if you just feed them enough ordinary data, and so finding behaviors like deception or manipulation is not even worth writing up.
And I think even you would abandon that nonchalant position if the "phenomenon" were sufficiently extreme... ("Sure, the LLM autonomously stalked and hunted down a person that a malicious user badmouthed, and called in a swatting using the Twilio API to get the person killed by the police; but you can find plenty of stuff like that in the Internet training corpus, so I don't understand why anyone is interested. This could have just been a reddit post.")