4 ms·
> the phrase doesn't only mean getting paperclipped. This is what most people mean when they say "run away", i.e. the machine behaves in a surreptitious way to
by root_axis 2y ago
> the phrase doesn't only mean getting paperclipped.
This is what most people mean when they say "run away", i.e. the machine behaves in a surreptitious way to do things it was never designed to do, not a catastrophic failure that causes harm because the AI did not perform reliably.
- ben_w 2y agoEvery error is surreptitious to those who cannot predict the behaviour of a few billion matrix operations, which is most of us. When people are not paying attention, they're just as dead if it's Therac-25 or Thule airforce base early warning radar or an actual paperclipper.
- root_axis 2y agoNo. Surreptitious means done with deliberate stealth to conceal your actions, not a miscalculation that results in a failure.
- ben_w 2y agoTo those who are dead, that's a distinction without a difference. So far as I'm aware, none of the "killer robots gone wrong" actual sci-fi starts with someone deliberately aiming to wipe themselves out, it's always a misspecification or an unintended consequence. The fact that we don't know how to determine if there's a misspecification or an unintended consequence is the alignment problem.
- root_axis 2y ago"Unintended consequences" has nothing to do with AI specifically, it's a problem endemic to every human system. The "alignment" problem has no meaning in today's AI landscape beyond whether or not your LLM will emit slurs.
- 8note 2y agoTo those who are dead, it doesn't matter if there was a human behind the wheel, or a matrix