I remember going to a talk in Berkeley by Nick Bostrom about AI Control theory after reading his book Superintelligence (in 2014?). What struck me at the time w

I remember going to a talk in Berkeley by Nick Bostrom about AI Control theory after reading his book Superintelligence (in 2014?). What struck me at the time was AI control theory was mostly pointless. If you put all these guard rails around your AI to keep it from turning everyone into paperclips (etc) then it's just not YOUR AI that turns everyone into paperclips/computronium, it's the person that doesn't put those guard rails in. Worse by putting those guard rails in you're making your AI less effective that the other guys so it can't even outcompete.