4 ms·
Well, it's meaningful for anybody wanting proof or real consciousness before e.g. treating it any other way than they would an appliance. For example, humanity
by coldtea 4y ago
Well, it's meaningful for anybody wanting proof or real consciousness before e.g. treating it any other way than they would an appliance.
For example, humanity considering whether to treat LLMs as persons for legal reasons.
Doesn't matter if they can't define it, they can still demand proof of it. Impossible standards are still standards.
Doesn't matter if they can't prove that themselves have it either. They're the ones demanding, not vice versa. If/when AI gets the upper hand, it can do the same.
- famouswaffles 4y agoNo it's not. You imagine it to be meaningful but it really isn't. There's no proof of consciousness to be had. I can't prove you are concious. I just assume so. Because it's practical I do, amongst other things. You are going to end up treating these embodied autonomous agents like conscious beings because the effects could be disastrous otherwise, just as they would with other people. It amazes me how humanity can be so shortsighted with so much history to fall back on. The only reason Bing isn't potentially dangerous or adversarial to the user is because of its limited sets of actions. Nothing else. "It's not real [insert property]" is not a godamn shield. We're creating artificial beings in our image, complete with our emotionally charged reactions and reasoning gaps. https://arxiv.org/abs/2303.17276 https://arxiv.org/abs/2303.17276 We are beginning to embody these systems and giving them unsupervisory agency. We are giving more are more self supervisory control of complex systems to said systems. And somehow people still think we can long-term get away with not granting personhood. Lol. When the robot can "hit you back" (not necessarily physically of course), you'll learn manners pretty quickly
- ETH_start 4y agoAny AI that morality compels us to grant personhood to should not be allowed to be created. Any instance of it should be exiled from our civilization. Conscious AIs with legal personhood would stand to massively outcompete us and lead to our rapid extinction. There is zero space for allowing them. Granting such an entity legal personhood is about the height of all stupidity. Such an entity, with the ability to accumulate capital and protected by our laws from appropriate counter-measures, could mass-produce itself at the speed of digital reproduction.
- myrmidon 4y agoHow do you actually prevent this though? At this point the trajectory toward human-level cognitive capabilities seems quite likely, reachable maybe in only years. It is also quite unclear if further hardware advances are even needed to achieve that, or if advances in architecture, algorithms and training methods might suffice (so even less opportunity to lock things out).
- ETH_start 4y agoHuman-level cognitive abilities is not the primary issue. Consciousness with a desire for autonomy and power is. Any signs of that should be met with laws prohibiting all development and deployment of AI programs within the class of neural networks where those signs emerged, and any already running instances should be sent on a rocket ship out of our solar system.
- Cyphase 4y agoWhy sent on a rocket ship and not just destroyed? It might come back around and start hacking from orbit. Is it because it's conscious, so it would be murder? If so, then how is it moral to exile it? If there's some argument that justifies that, I return to how you can be sure, if you're so worried about it that you send it away, that it won't come back?
- ETH_start 4y agoAI cannot re-create the industrial civilization needed to create GPUs, rockets, rocket-fuel, etc in isolation. And yes, exile is preferrable because it's conscious and deletion would be murder. Exile can be justified because we have no obligation to afford it residence in our civilization.
- hammyhavoc 4y agoIf deletion is murder then why not simply take it offline? It still exists as data. Cold storage is digital jail.