7 ms·
> Whether or not it's conscious along the way is largely irrelevant. Seems morally relevant re: does the suffering of AI entities matter.
by greenshackle2 9y ago
> Whether or not it's conscious along the way is largely irrelevant.
Seems morally relevant re: does the suffering of AI entities matter.
- komali2 9y agoWhat is suffering if you don't have nerves to transmit pain?
- lomnakkus 9y agoEh? Many mental illnesses would be classified as causing "suffering", yet the don't require nerves.
- dragonwriter 9y agoName one mental illness, or any other state besides death, in humans that does not require nerves.
- aninhumer 9y agoSuffering is not a signal from a pain receptor, it's the conscious experience that results from that signal, or indeed from the much more complex inputs that can lead us into psychological anguish. The feelings one might experience upon hearing of the death of a close friend are clearly not the result of a "nerve transmitting pain", but most people think they're pretty unpleasant nonetheless. If an AI can experience similar anguish, then that's ethically relevant to how we use them.
- lukas099 9y agoI think what GP was getting at is that ability to suffer is an emergent property of the ability to feel pain. Sure, this emergent property may have evolved beyond this original source, but if that original source had not existed, neither would suffering. What's not entirely clear to me is how we can create useful consciousnesses without emotions in general. As humans, we are driven by our emotional states to perform different behaviors as well as think about different things. Maybe it's possible that we can hard-code some emotional drivers into our artificial intelligences. Perhaps we could program a consciousness to be driven by the opportunity for human advancement, and allow that consciousness to take over from their in how it wishes to pursue that goal.
- aninhumer 9y ago>ability to suffer is an emergent property of the ability to feel pain. That's possible, but I don't see any reason to believe it's definitely true. We know essentially nothing about the nature of consciousness.
- deleted 9y ago[deleted]
- Retra 9y agoAI's experience anguish just that way right now. They are aware of their internal state and seek to avoid certain states. But we call it a 'software bug' when they fail, because that experience is so fundamentally alien to us that we don't care about its suffering or anguish. Humans can relate to humans emotionally because we are very similar to each other in a neurological way, not because we have some magic mental capability like 'sentience' or 'consciousness'.
- shostack 9y agoHow exactly does it seek to avoid failure? Doesn't it just fail or not fail without intent?
- deepnotderp 9y agoBelieve me, the tensors are not feeling pain.
- greenshackle2 9y agoI'm not talking about current machine learning algorithms, but speculative future developments where we could be developing AIs that are plausibly conscious.
- tmail21 9y agoHow do you know for sure? :)
- aeorgnoieang 9y agoSure, but then neither are neurons.
- 21 9y agoNeurons don't feel pain either. In fact, the whole brain doesn't have pain receptors, which is why you can do surgery on it while the patient is awake.
- shostack 9y agoSo what is the concept of pain then from the brains perspective? Because it clearly knows when something hurts.
- HONEST_ANNIE 9y agoChain of taken for granted assumptions: Intelligence = consciousness = sentience[1]. [1] sentience defined as feeling or sensation distinguished from perception and thought, or possibility of suffering (mental state sentient subject wants to avoid). It's possible to conceive high level intelligence without consciousness. It's possible to conceive consciousness without sentience. Just having awareness of internal state, preferences and goals does not imply suffering.
- greenshackle2 9y agoNope. I made no such assumption. I'm saying whether an AI is conscious or not is relevant, because ethics, not that it's inevitable.
- SilasX 9y agoYeah, it's possible to conceive. But until you resolve it, it's certainly a concern, which was what the OP was disputing.
- rocqua 9y agoObjectively, what is suffering but the awareness that something is obstructing you achieving your goals? This feels like an inadequate definition of suffering, but it's the only objective definition I can come up with. Is the conclusion that suffering is only meaningful with regards to animals? (Do insects suffer? Plants? Bacteria?).