3 ms·
Both Asimov and Arthur C. Clarke predicted that neurotic and eventually homicidal robots would be the end result of imprinting AI with contradictory goals which
by atlantic 3y ago
Both Asimov and Arthur C. Clarke predicted that neurotic and eventually homicidal robots would be the end result of imprinting AI with contradictory goals which are impossible to reconcile. We seem to be doing our best to make this scenario come to pass.
- deleted 3y ago[deleted]
- godelski 3y agoAsimov wrote a lot about what we could call alignment. I'd argue that our focus on benchmark based evaluations is akin to a misalignment with what we are actually trying to evaluate. While benchmarks are great tools and highly useful, the over-reliance of them is many a short story by Asimov.
- 13years 3y agoI perceive current alignment theory as attempting to solve a paradox. The entire concept of solving alignment by aligning to human value systems is flawed from its premise. We aren't aligned ourselves and exhibit unpredictable behaviors. Further elaboration of the flaws in concept I've written here: https://www.mindprison.cc/p/ai-singularity-the-hubris-trap https://www.mindprison.cc/p/ai-singularity-the-hubris-trap
- flangola7 3y agoMy grandfather came to this conclusion early in the cold war as it dawned that humans had reached the point of reducing global destruction down into a push-button. Human capacity for tool making greatly outstrips human capacity for responsibility. You wouldn't give a baby a loaded pistol, but unfortunately the baby went and built a nova bomb.