I have a feeling a lot of these models take advantage of in-built language pattern-matching to which we can't help but ascribe meaning. A puppy can't help but c

I have a feeling a lot of these models take advantage of in-built language pattern-matching to which we can't help but ascribe meaning. A puppy can't help but chase a laser pointer because his prey drive compels him to. Likewise there will always be people who take this kind of chatbot output at face value because the signals resemble empathy well enough. Not everyone is a game theorist or has an opinion about AI alignment/effects one way or another, and they will be presented with this tech they won't care to question.