3 ms·

Should we really be openly discussing our plans for an ‘off-switch’ on the public Internet? Shouldn’t there be some attempt to keeps the ideas/plans hidden in a

by lbenes 10y ago

Should we really be openly discussing our plans for an ‘off-switch’ on the public Internet? Shouldn’t there be some attempt to keeps the ideas/plans hidden in a way that they won’t be archived/read by an AI from the future? If I were seriously worried about this, I would put my plans and all discussions behind a CAPTCHA + paywall like structure that could not be crawled/archived.

markyc 10y ago
if current algorithms can kick our butts at chess, an eventual future AI would pretty much know what we would do before we think of it
camtarn 10y ago
The document now leads to a 404. I guess somebody heard you ;)
- IE6 10y ago
  Or AI learned of the off switch and executed the off switch on the file.
bobajeff 10y ago
Wouldn't CAPTCHA be useless against a sufficiently smart AI?
toomim 10y ago
Then the AI would pay someone to solve the captcha so it can read about its kill switch.
CM30 10y ago
I think the captcha would be kind of useless, but the paywall might be able to prevent any issues in itself. Unless AI start being offered credit cards in the future, it's unlikely it'll be able to pay to get past one. So what's left? Trick some poor human to let it in? On the other hand, a real life robot has a fairly easy to use off switch. It's called 'destroy the robot with copious amounts of firepower'.
- alanbernstein 10y ago
  I imagine an AI with internet access could manage to find a few credit card numbers...
freedamn 10y ago
If the thing is anything evolving from an internet, it would surely know how to shut off or have a strong incentive not to. We would have, but then you don't want the plans known. I see.
sullyj3 10y ago
It doesn't take a superintelligence to reason that the less intelligent people who created you probably took out some safety measures in case of you going rogue, and to figure that one of them is probably a kill switch. It's just the obvious thing to do. The AI doesn't need to stumble across past vague theorizing in order for this to occur to it.

by lbenes 10y ago

markyc 10y ago

if current algorithms can kick our butts at chess, an eventual future AI would pretty much know what we would do before we think of it

camtarn 10y ago

The document now leads to a 404. I guess somebody heard you ;)

IE6 10y ago
Or AI learned of the off switch and executed the off switch on the file.

bobajeff 10y ago

Wouldn't CAPTCHA be useless against a sufficiently smart AI?

toomim 10y ago

Then the AI would pay someone to solve the captcha so it can read about its kill switch.

CM30 10y ago

I think the captcha would be kind of useless, but the paywall might be able to prevent any issues in itself. Unless AI start being offered credit cards in the future, it's unlikely it'll be able to pay to get past one. So what's left? Trick some poor human to let it in? On the other hand, a real life robot has a fairly easy to use off switch. It's called 'destroy the robot with copious amounts of firepower'.

alanbernstein 10y ago
I imagine an AI with internet access could manage to find a few credit card numbers...

freedamn 10y ago

If the thing is anything evolving from an internet, it would surely know how to shut off or have a strong incentive not to. We would have, but then you don't want the plans known. I see.

sullyj3 10y ago

It doesn't take a superintelligence to reason that the less intelligent people who created you probably took out some safety measures in case of you going rogue, and to figure that one of them is probably a kill switch. It's just the obvious thing to do. The AI doesn't need to stumble across past vague theorizing in order for this to occur to it.