The main danger (but certainly not the only danger) is that the AI kills us all for reasons that have been articulated for 20 years including in books by respec

The main danger (but certainly not the only danger) is that the AI kills us all for reasons that have been articulated for 20 years including in books by respected academics like Nick Bostrom. The techniques used to 'steer' or 'aim' the AI stop working once the AI becomes better than humans (and human institutions like the FBI or Microsoft) at certain cognitive capabilities like making intricate plans that will succeed in spite of determined human opposition. Researchers employed full-time at the Machine Intelligence Research Institute have been trying to solve this 'control' or 'alignment' problem continuously for 20 years, but progress has been very slow compared to 'progress' on just building dangerous AI.