4 ms·
Death and Suicide in Universal Artificial Intelligence
- irascible 10y agoWat
- amelius 10y agoCan somebody explain this? Also, I wonder if a hypothetical human who has never been in contact with other humans or living organisms would ponder about death and suicide. I think this human would not even know these concepts exist. So why would this hold for an AI?
- TheOtherHobbes 10y agoThe idea is that you can make an AI system that gives up if it gets too smart, which guarantees that you don't get a world-eating AI singularity explosion. The alternative approach relies on putting tripwires in the system, so that the AI gives up if it tries to do something you specifically don't want it to - like launching all the world's nuclear missiles, or maybe getting its own Hollywood agent. The problem with tripwires is that a really smart agent can modify itself to bypass them, or at least find the loopholes you didn't think of because you're not as smart as it is. The systems mentioned - AIXI, etc - are all formalisms for understanding/modelling general AI systems. https://en.wikipedia.org/wiki/AIXI https://en.wikipedia.org/wiki/AIXI
- deleted 10y ago[deleted]
- nl 10y agoHutter (one of this paper's authors) is the inventor of AIXI.
- grondilu 10y agoThe author gives an alternative characterization of death as a state with nul reward. I interpret this and other assertions in the article as the possibility that an AI system, even if it does not know about death, can chose complete inaction, which for all intents and purposes can be assimilated to death.
- nl 10y agoNice title for something that is mostly kinda boring. Basically this is saying the reinforcement learning systems (and other ML systems?) can get stuck in states from which they cannot escape. They label these states "death" They go on to define various agent behaviours, which given starting states lead to different equilibriums. The ones that actively lead to certain death they label "suicide"
- deleted 10y ago[deleted]
- grondilu 10y agoIsn't this basically a computer science approach to Hamlet's monologue? If so, it's kind of cool.