Agreed, but that's trivial to fix. The conceptual problem is that there is a huge intersection between the set of "things the agent needs to be able to do in o

Agreed, but that's trivial to fix. The conceptual problem is that there is a huge intersection between the set of "things the agent needs to be able to do in order to be useful" and "things that are potentially dangerous."