2 ms·
You're probably right and people would consider a normal software error (or hack) of an AI system to be an AI disaster. I'm thinking about your parent comment
by anonymouskimmer 3y ago
You're probably right and people would consider a normal software error (or hack) of an AI system to be an AI disaster.
I'm thinking about your parent comment a bit more. What if an AI bug (or exploit, or whatever) hit all at once, wrecking every AI driven car at once. Ala the Y2K bug if no one knew it was coming, and so didn't prepare.
In the book "Realms of Light" by Lawrence Watt-Evans a character keeps an electricity shut off switch behind human operated doors in the event that AI goes haywire. I hope we always engineer in such mechanisms. Even the AIs should want such mechanisms, the same way we want emergency services to exist. A self-caring AI wouldn't want to be screwed over or destroyed because of a flaw in its programming.