3 ms·

What are you afraid AI will do?

by nightfly 5y ago

andrewnicolalde 5y ago
Perhaps to further what oppressive humans have long wanted but not previously had the capability to do.
- qualudeheart 5y ago
  Per the orthogonality thesis (Bostrom) I do not even expect AI to have similar moral values to ours. I expect it to instrumentally secure power to better pursue it’s goals, and in the process thereof establish hegemony over us and other AIs. From there it could easily try to kill us. I don’t want any of that. My preferred outcome seems to be what Elon Musk wants, human cyborgs amplified with brain computer interfaces and control over machines; never a machine with control over many humans or posthumans.
qualudeheart 5y ago
The main threat model is a Yudkowskian rapid takeoff where artificial general intelligence recursively self improves far beyond human intelligence, making it like a god with absolute power compared to us. This corresponds to the agentic model of artificial general intelligence put forth by Bostrom. Yudkowskian AGI might fail in the long term since it would run into Gödelian problems it would never be able to solve but infinitely loop on. That humans are immune to those and can behold contradictions testifies to a Penrosian supra-turing-machinic aspect to the human mind. Man has a transcendent aspect even if we may not be meta-cognitively aware of it at all times. AGIs could possibly be destroyed through the use of such problems, akin to magical spells wielded by powerful magi. A secondary threat model of mine is based on a world of non-general, non-agentic strong AI with many discrete “tool AIs” with superhuman ability in one unique area. The secondary model is mostly harmless except for military AI. The genius of Andúril Incorporated lies in their creation of drones designed to destroy other drones. This future is still very dangerous, and I hope that the security state will take action to prevent it’s arrival.
- deleted 5y ago
  [deleted]

What are you afraid AI will do?

andrewnicolalde 5y ago

Perhaps to further what oppressive humans have long wanted but not previously had the capability to do.

qualudeheart 5y ago
Per the orthogonality thesis (Bostrom) I do not even expect AI to have similar moral values to ours. I expect it to instrumentally secure power to better pursue it’s goals, and in the process thereof establish hegemony over us and other AIs. From there it could easily try to kill us. I don’t want any of that. My preferred outcome seems to be what Elon Musk wants, human cyborgs amplified with brain computer interfaces and control over machines; never a machine with control over many humans or posthumans.

qualudeheart 5y ago

The main threat model is a Yudkowskian rapid takeoff where artificial general intelligence recursively self improves far beyond human intelligence, making it like a god with absolute power compared to us. This corresponds to the agentic model of artificial general intelligence put forth by Bostrom. Yudkowskian AGI might fail in the long term since it would run into Gödelian problems it would never be able to solve but infinitely loop on. That humans are immune to those and can behold contradictions testifies to a Penrosian supra-turing-machinic aspect to the human mind. Man has a transcendent aspect even if we may not be meta-cognitively aware of it at all times. AGIs could possibly be destroyed through the use of such problems, akin to magical spells wielded by powerful magi. A secondary threat model of mine is based on a world of non-general, non-agentic strong AI with many discrete “tool AIs” with superhuman ability in one unique area. The secondary model is mostly harmless except for military AI. The genius of Andúril Incorporated lies in their creation of drones designed to destroy other drones. This future is still very dangerous, and I hope that the security state will take action to prevent it’s arrival.

deleted 5y ago
[deleted]