5 ms·
The AI vs AI security arms race is something that has been well predicted in genres like cyberpunk. It's fiction, but fiction grounded in reality. First, we'd
by pixl97 2mo ago
The AI vs AI security arms race is something that has been well predicted in genres like cyberpunk. It's fiction, but fiction grounded in reality.
First, we'd see this. Highly capable hacking AI with vast resources performing attacks against standard computing platforms that overwhelm human operators.
Second, human operators deploy capable adaptive protection AI to fend off AI attacks in realtime.
Then, the attacking AI partially switches from attacking programs to attacking protective AI.
The situation devolves to an arms race of tit-for-tat. You start seeing some protection AI running counter attacks against the attacking AI.
The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".
- Henchman21 2mo agoWintermute smiles
- raddan 2mo agoThere’s a great and terrifying story by Stanislaw Lem about the endgame of an AI arms race called “The Invincible” [1]. It’s hard for me not to wonder whether AI run amok will play out to make the world uninhabitable more like Lem’s vision than The Terminator’s. [1] https://en.wikipedia.org/wiki/The_Invincible https://en.wikipedia.org/wiki/The_Invincible
- simur 2mo agoA bit off topic, but there is a game on Steam based on the story, also called "The Invincible" [1] [1] https://store.steampowered.com/app/731040/The_Invincible/ https://store.steampowered.com/app/731040/The_Invincible/
- rpcope1 2mo agoSo you're saying it's probably time for me to just unplug the internet?
- solstice 2mo agoNot necessarily, but keeping an airgapped machine and Read-only backups somewhere seems more and more sensible. We're all going to get hacked eventually now
- fsflover 2mo agoOr consider using Qubes OS, which for certain threat models is more secure than air gaping: https://doc.qubes-os.org/en/latest/introduction/faq.html#how-does-qubes-os-compare-to-using-a-separate-physical-machine https://doc.qubes-os.org/en/latest/introduction/faq.html#how...
- blagie 2mo agoThe problem is that, in this arms race, unaligned AI has a competitive advantage over aligned AI. The second problem -- already seen in Ukraine v. Russia -- is that in a high-stakes situation, humans will take every safeguard off.
- pixl97 2mo agoExactly. Aligned AI is a high energy state as it has to keep a bunch of human behavior in mind that have little to nothing to do with its future survival states.
- rapind 2mo ago> The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on". Humans are paper clips long before that.
- protocolture 2mo agoI dont think so. My read is that its a bit like Cryptolocker. Cryptolocker wrapped up everyone who was operating with shitty desktop security practices. But if you had good discipline, good backups and solid infra you just laughed as everyone else drowned. Everyone operating below best practice is going to holler and crow about how hard done by they are, but once they start implementing best practices they have little to worry about. I mean on the linux side of things, Ubuntu Pro will literally run off and harden your image for you. They are gonna make bank.