4 ms·

I'm just not seeing any real examples, exotic or otherwise, of how to recognize the risks involved in superhuman AI. Smarter than us does not imply any particu

I'm just not seeing any real examples, exotic or otherwise, of how to recognize the risks involved in superhuman AI. Smarter than us does not imply any particular will or agency. Of course the will and agency of the people employing the technology will reveal its immediate impact, likely toward short term profit, and alignment as a control plane employed toward the same. Chimpanzees have limited control over humans, humans have limited control over their own technology. But of course chimpanzees can recognize the risk of armed people. The point is not to debunk fanciful end games. Better to prepare for likely effects on the human network. I was promised a list.

cubefox 4y ago
"Recognize the risk" what does that mean? That advanced AI would could overpower us? That it is likely that it would want to overpower us?
- cwmoore 4y ago
  Your link suggests the relative likelihood of AI destroying all carbon based life or saving the world from "various stupidities". If it is somewhere in between in its influence, and changes anything, isn't it still reasonable to call it a risk? OP promised a list of scenarios by which AGI leads to total devastation, with strong language for GP. For clarity, I don't think that it is very likely that an unimaginable silicon takeover is the most probable outcome. But like with the gun or the printing press, there will be winners and losers, and society will shift.