AGI doesn't matter, it's a red herring. You don't need an unaligned AGI for AI to cause harm to human society. You just need a bad actor to use the AI in a har

AGI doesn't matter, it's a red herring. You don't need an unaligned AGI for AI to cause harm to human society. You just need a bad actor to use the AI in a harmful way. Whether the harmful behaviour is a result of an aligned AGI or a human bad actor is irrelevant. It's like worrying if Trump or C3PO has access to a nuclear red button. For example, I do believe it's reasonably likely that GPT-4 or GPT-5 could have super human hacking abilities. That's worrying because governments or even individuals with access to power like that could do huge amounts of damage. We don't need AGI for GPT-5 to be used in a destructive way. And there's a lot of bad use cases like this. AI could be used to manipulate and scam humans. It could be used to create computer viruses. Potentially in the future it could even be used to create biological viruses. This is the risk we need to be focusing on ASAP. I don't quite agree on the timelines here, but I do agree AGI is a risk. But AGI is only a risk if you already have AI models that are already advanced enough that they can cause harm.