3 ms·
Here is a much more realistic example: https://twitter.com/RokoMijic/status/1641806556038676481 https://twitter.com/RokoMijic/status/1641806556038676481 In gen
by cubefox 4y ago
Here is a much more realistic example: https://twitter.com/RokoMijic/status/1641806556038676481 https://twitter.com/RokoMijic/status/1641806556038676481
In general, the argument "All the examples how AI would overpower us are way too exotic for my taste" is like one chimpanzee complaining to another chimpanzee "Your example how humans would overpower us is totally implausible and not worth taking seriously." The mistake is that both have not the intelligence to invent or understand a realistic example, but that is not at all evidence that humans can't overpower chimpanzees.
- cwmoore 4y agoI'm just not seeing any real examples, exotic or otherwise, of how to recognize the risks involved in superhuman AI. Smarter than us does not imply any particular will or agency. Of course the will and agency of the people employing the technology will reveal its immediate impact, likely toward short term profit, and alignment as a control plane employed toward the same. Chimpanzees have limited control over humans, humans have limited control over their own technology. But of course chimpanzees can recognize the risk of armed people. The point is not to debunk fanciful end games. Better to prepare for likely effects on the human network. I was promised a list.
- cubefox 4y ago"Recognize the risk" what does that mean? That advanced AI would could overpower us? That it is likely that it would want to overpower us?
- cwmoore 4y agoYour link suggests the relative likelihood of AI destroying all carbon based life or saving the world from "various stupidities". If it is somewhere in between in its influence, and changes anything, isn't it still reasonable to call it a risk? OP promised a list of scenarios by which AGI leads to total devastation, with strong language for GP. For clarity, I don't think that it is very likely that an unimaginable silicon takeover is the most probable outcome. But like with the gun or the printing press, there will be winners and losers, and society will shift.
- joshuahedlund 4y agoI don’t think those examples are believable, there’s a ton of hand waving like “secretly hack and install secret copies” and “automate the economy” (what does that even mean) (In science fiction everyone gets a perfect robot butler. In the real world, the poorest 20% never get one, another 20% cancel the monthly subscription, another chunk forget to keep it charged or accidentally pour juice on it or live inside a concrete apartment that blocks the satellite signal that now is the time to use the sharp knife) I don’t think the analogy holds either. Chimpanzees were not smart enough to invent humans. The higher you ascend levels of intelligence, the higher ability you have both to imagine what a higher level would be like and to understand potential constraints it might have. A lack of imagination is not evidence against the hypothesis, but it’s also not evidence that the probability is more than 1 in a billion (or whatever)