3 ms·
The idea is that you can make an AI system that gives up if it gets too smart, which guarantees that you don't get a world-eating AI singularity explosion. The
by TheOtherHobbes 10y ago
The idea is that you can make an AI system that gives up if it gets too smart, which guarantees that you don't get a world-eating AI singularity explosion.
The alternative approach relies on putting tripwires in the system, so that the AI gives up if it tries to do something you specifically don't want it to - like launching all the world's nuclear missiles, or maybe getting its own Hollywood agent.
The problem with tripwires is that a really smart agent can modify itself to bypass them, or at least find the loopholes you didn't think of because you're not as smart as it is.
The systems mentioned - AIXI, etc - are all formalisms for understanding/modelling general AI systems.
https://en.wikipedia.org/wiki/AIXI https://en.wikipedia.org/wiki/AIXI
- deleted 10y ago[deleted]
- nl 10y agoHutter (one of this paper's authors) is the inventor of AIXI.