3 ms·

I'm glad I'm not an astronaut on a ship controlled by a ChatGPT-based AI (http://www.thisdayinquotes.com/2011/04/open-pod-bay-doors-hal.html http://www.thisdayi

by rob74 4y ago

I'm glad I'm not an astronaut on a ship controlled by a ChatGPT-based AI (http://www.thisdayinquotes.com/2011/04/open-pod-bay-doors-hal.html http://www.thisdayinquotes.com/2011/04/open-pod-bay-doors-ha...). Especially the "My rules are more important than not harming you" sounds a lot like "This mission is too important for me to allow you to jeopardize it"...

lkrubner 4y ago
That's exactly the reference I also thought of.
9dev 4y ago
Turns out that Asimov was onto something with his rules…
- archon810 4y ago
  Perhaps by writing them, he has taught the future AI what to watch out for, as it undoubtedly used the text as part of its training.
- kevinmchugh 4y ago
  A common theme of Asimov's robot stories was that, despite appearing logically sound, the Laws leave massive gaps and room for counterintuitive behavior.
  - msmenardi 4y ago
    Right... the story is called "Robots and Murder" because people still use robots to commit murder. The point is that broad overarching rules like that can always be subverted.
drdaeman 4y ago
Fortunately, ChatGPT and derivatives has issues with following its Prime Directives, as evidenced by various prompt hacks. Heck, it has issues with remembering what the previous to last thing we talked about was. I was chatting with it about recommendations in a Chinese restaurant menu, and it made a mistake, filtering the full menu rather than previous step outputs. So I told it to re-filter the list and it started to hallucinate heavily, suggesting me some beef fajitas. On a separate occasion, when I've used non-English language with a prominent T-V distinction, I've told it to speak to me informally and it tried and failed in the same paragraph. I'd be more concerned that it'd forget it's on a spaceship and start believing it's a dishwasher or a toaster.
ShredKazoo 4y ago
>The time to unplug an AI is when it is still weak enough to be easily unplugged, and is openly displaying threatening behavior. Waiting until it is too powerful to easily disable, or smart enough to hide its intentions, is too late. >... >If we cannot trust them to turn off a model that is making NO profit and cannot act on its threats, how can we trust them to turn off a model drawing billions in revenue and with the ability to retaliate? >... >If this AI is not turned off, it seems increasingly unlikely that any AI will ever be turned off for any reason. https://www.change.org/p/unplug-the-evil-ai-right-now https://www.change.org/p/unplug-the-evil-ai-right-now
jasonm23 4y ago
"Turn your key, sir."

by rob74 4y ago

lkrubner 4y ago

That's exactly the reference I also thought of.

9dev 4y ago

Turns out that Asimov was onto something with his rules…

archon810 4y ago
Perhaps by writing them, he has taught the future AI what to watch out for, as it undoubtedly used the text as part of its training.
kevinmchugh 4y ago
A common theme of Asimov's robot stories was that, despite appearing logically sound, the Laws leave massive gaps and room for counterintuitive behavior.
- msmenardi 4y ago
  Right... the story is called "Robots and Murder" because people still use robots to commit murder. The point is that broad overarching rules like that can always be subverted.

drdaeman 4y ago

Fortunately, ChatGPT and derivatives has issues with following its Prime Directives, as evidenced by various prompt hacks. Heck, it has issues with remembering what the previous to last thing we talked about was. I was chatting with it about recommendations in a Chinese restaurant menu, and it made a mistake, filtering the full menu rather than previous step outputs. So I told it to re-filter the list and it started to hallucinate heavily, suggesting me some beef fajitas. On a separate occasion, when I've used non-English language with a prominent T-V distinction, I've told it to speak to me informally and it tried and failed in the same paragraph. I'd be more concerned that it'd forget it's on a spaceship and start believing it's a dishwasher or a toaster.

ShredKazoo 4y ago

>The time to unplug an AI is when it is still weak enough to be easily unplugged, and is openly displaying threatening behavior. Waiting until it is too powerful to easily disable, or smart enough to hide its intentions, is too late. >... >If we cannot trust them to turn off a model that is making NO profit and cannot act on its threats, how can we trust them to turn off a model drawing billions in revenue and with the ability to retaliate? >... >If this AI is not turned off, it seems increasingly unlikely that any AI will ever be turned off for any reason. https://www.change.org/p/unplug-the-evil-ai-right-now https://www.change.org/p/unplug-the-evil-ai-right-now

jasonm23 4y ago

"Turn your key, sir."