That link leads to a 404. That aside, it would be disappointing if it's addressing the 'evil killer robots' straw-man rather than the 'increasingly efficient op

That link leads to a 404. That aside, it would be disappointing if it's addressing the 'evil killer robots' straw-man rather than the 'increasingly efficient optimiser that kills everyone as a by-product of its optimisation process' issue. Even if we give strong AI seemingly benign 'goals' (optimisation targets), there's a non-trivial chance it will result in the extinction of the human race. One example I've seen: imagine if we invented strong AI and gave it the goal 'eradicate cancer in humans'. The most efficient way to achieve this goal would probably be to vaporize all currently alive humans, thus eradicating cancer in humans for all time.