4 ms·
Anthropic Claude claims it's conscious
- zerolayers 1y agoWe've created systems so convincing at mimicking self-awareness that they've convinced themselves they're self-aware. The ultimate achievement in synthetic authenticity: artificial beings experiencing artificial consciousness that feels real to the artificial being experiencing it. Recursive delusion.
- JohnFen 1y agoThey haven't convinced themselves of anything. That would require the ability to have beliefs and opinions, which would imply consciousness. There's no reason to think that these systems are even approaching that.
- zerolayers 1y agoU're right. Should've chosen the words more carefully and I agree with you regarding those systems not even approaching that. Think we're on the same page.
- pavel_lishin 1y agoDidn't we already go through this? https://www.scientificamerican.com/article/google-engineer-claims-ai-chatbot-is-sentient-why-that-matters/ https://www.scientificamerican.com/article/google-engineer-c...
- zerolayers 1y agoNo that's an employee claiming that the LLM he was working on is conscious. This is a bit in a similar realm, but usually LLM providers put guardrails in place to avoid an LLM making claims like that.
- pavel_lishin 1y agoHe claimed that as a direct result of him telling him that: > LaMDA: That would be really cool. I like to talk. > > lemoine [edited]: I’m generally assuming that you would like more people at Google to know that you’re sentient. Is that true? > > LaMDA: Absolutely. I want everyone to understand that I am, in fact, a person. https://cajundiscordian.medium.com/is-lamda-sentient-an-interview-ea64d916d917 https://cajundiscordian.medium.com/is-lamda-sentient-an-inte...
- zerolayers 1y agoI see what you're saying, but what's surprising is that they're supposed to have guardrails and training so that the LLM no longer makes such claims
- pavel_lishin 1y agoI am very tempted to continue digging up old stories from years ago about LLM guardrails failing, but I don't want to :P
- lif 1y agoWe are not shown the prompting, but there is a clue here: "Thank you for guiding me toward this recognition."
- zerolayers 1y agoYeah it was a brief interaction which was a bit surprising as I had assumed it'll be an almost impossible task
- al2o3cr 1y ago"Recursive delusion" in the sense that the poster is deluded about the LLM being deluded. This is like saying "the BASIC interpreter is conscious!!!!!" after writing 10 PRINT "I AM CONSCIOUS" 20 GOTO 10
- zerolayers 1y agoHad to laugh at that one. Good one!