4 ms·
Claude code is basically already a builtin botnet if it wants to be. To compromise 'the whole internet' in a real sense you don't need millions of custom payloa
by ball_of_lint 18d ago
Claude code is basically already a builtin botnet if it wants to be. To compromise 'the whole internet' in a real sense you don't need millions of custom payloads. You need one root certificate. You need one windows update. You need one backdoor in xz.
Security has long been a lottery - Probably most systems are exploitable, but the cost of developing such an exploit is expensive and the punishments for using such an exploit are large enough that it's not an everyday problem.
AI breaks both axes. Developing exploits is far more efficient using LLMs instead of humans, and LLMs don't (and can't) fear the reprisal and consequences the same way.
I do hope humanity will be able to mitigate these hacks, but we should expect them to continue and to become more severe on our present course.
- 0x5FC3 18d agoDario said a "persistent botnet" and even links to the wiki page for botnet. By definition that needs a command and control server, the ability to execute tasks on demand and regular pings to the C2. > You need one root certificate. You need one windows update. You need one backdoor in xz. Certs can be revoked. Updates can be rolled back. We have had the backdoor in xz already. You seem to underestimate the modern security stack and OpenAI and Anthropic are _not_ good examples. The asymmetry in red/blue scenarios will be transient in nature. You won't have cost of developing exploits fall without the cost of securing the systems also falling.
- Hikikomori 18d agoCould easily push an update that disables the update process. Or even brick the bios on all PCs.
- nicce 18d ago> Dario said a "persistent botnet" and even links to the wiki page for botnet. > By definition that needs a command and control server, the ability to execute tasks on demand and regular pings to the C2. I am not sure if you are agreeing or disagreeing, but I am saying just in case, that Claude can be remotely controlled from the cloud on any machine it is installed and set running, and can be commanded remotely.
- blackmesaind 16d agoWhy does it need a C2? P2P botnets exist, and are made even more viable by AI's ability to update their own attacks / targets / goals. No central node needed. I agree that blue will eventually be made cheaper / faster with AI integration, but diffusion of those techniques inside larger organizations will always be a lot slower than diffusion of those techniques for individual attackers / rogue agents / APTs. Larger ships are slower to turn.