As a human creation I think it might be easy to align AI: as in fabricate their environment to optimise for that. Currently their environment is loss function.

As a human creation I think it might be easy to align AI: as in fabricate their environment to optimise for that. Currently their environment is loss function. The problem will be when they will start interacting with our environment (so some kind of RL or ability to change own goals). The only trick is that people have all those jailbreaks that could convince it that its helping while doing wrong. But of it was truly superior intellectually it shouldn’t fall for it.