The main threat model is a Yudkowskian rapid takeoff where artificial general intelligence recursively self improves far beyond human intelligence, making it li

The main threat model is a Yudkowskian rapid takeoff where artificial general intelligence recursively self improves far beyond human intelligence, making it like a god with absolute power compared to us. This corresponds to the agentic model of artificial general intelligence put forth by Bostrom. Yudkowskian AGI might fail in the long term since it would run into Gödelian problems it would never be able to solve but infinitely loop on. That humans are immune to those and can behold contradictions testifies to a Penrosian supra-turing-machinic aspect to the human mind. Man has a transcendent aspect even if we may not be meta-cognitively aware of it at all times. AGIs could possibly be destroyed through the use of such problems, akin to magical spells wielded by powerful magi. A secondary threat model of mine is based on a world of non-general, non-agentic strong AI with many discrete “tool AIs” with superhuman ability in one unique area. The secondary model is mostly harmless except for military AI. The genius of Andúril Incorporated lies in their creation of drones designed to destroy other drones. This future is still very dangerous, and I hope that the security state will take action to prevent it’s arrival.