To quote Joscha Bach's "Lebowski Theorem of Machine Superintelligence": > No super-intelligent system is going to do anything that is harder than hacking its r

To quote Joscha Bach's "Lebowski Theorem of Machine Superintelligence": > No super-intelligent system is going to do anything that is harder than hacking its reward function Or in other words, there may be a chance a super intelligent AI is possible but won't go full skynet because it's not the most satisfying outcome.