I interpret that more like, LLMs imitate human speech, so the more accurately they imitate humans, the more useful social engineering skills become. Not because

I interpret that more like, LLMs imitate human speech, so the more accurately they imitate humans, the more useful social engineering skills become. Not because you are truly social engineering ChatGPT, of course, but because ChatGPT will pretend you did. In this case, nudging the human (that ChatGPT is pretending to be) to behave like a better, smarter version of themselves.