> Societies don't have the right to decide for others what their choices should be. If an AGI starts inventing new and wonderful ways in which we can destroy o

> Societies don't have the right to decide for others what their choices should be. If an AGI starts inventing new and wonderful ways in which we can destroy ourselves, and we are taken in by it, we will have to restrict that, it's non optional. You can make the argument that, say, current hard drugs should be legal - but I don't think there's a way to defend the position that any possible future 'thing' should always be legal/permitted regardless of negative effect.