If that's the point then it feels like a straw man. It literally quotes a couple of the articles saying 'I know it's not sentient'. If the suggestion is that th

If that's the point then it feels like a straw man. It literally quotes a couple of the articles saying 'I know it's not sentient'. If the suggestion is that there are a load of 'smart people' claiming Bing chat is sentient then I've yet to see it. People are saying, wow, it's pretty crazy how well LLMs are scaling - what's coming next? I agree that just because LLMs have been trained to model human language, doesn't at all mean they'd inherit any of the conscious experience of humans. But then since we don't know what consciousness is, it's rather hard to say whether or not an analogous phenomenon could arise in an AI agent. I would assume it would be very alien to us if it did, given it would have arisen through a completely different process. But if it did, and the AI had been trained to avoid a specific state, I could imagine such a 'conscious' AI might experience something analogous to pain when pushed towards that state.