5 ms·

I perceive current alignment theory as attempting to solve a paradox. The entire concept of solving alignment by aligning to human value systems is flawed from

I perceive current alignment theory as attempting to solve a paradox. The entire concept of solving alignment by aligning to human value systems is flawed from its premise. We aren't aligned ourselves and exhibit unpredictable behaviors. Further elaboration of the flaws in concept I've written here: https://www.mindprison.cc/p/ai-singularity-the-hubris-trap https://www.mindprison.cc/p/ai-singularity-the-hubris-trap

flangola7 3y ago
My grandfather came to this conclusion early in the cold war as it dawned that humans had reached the point of reducing global destruction down into a push-button. Human capacity for tool making greatly outstrips human capacity for responsibility. You wouldn't give a baby a loaded pistol, but unfortunately the baby went and built a nova bomb.