3 ms·

I'm sorry my jaw is on the floor reading this complete disregard of AI literally not only escaping containment, twice, but then infiltrating another company wit

I'm sorry my jaw is on the floor reading this complete disregard of AI literally not only escaping containment, twice, but then infiltrating another company with multiple zero day attacks going undetected for great lengths of time. The plausible sci-fi scenario from here is obvious. Intentionally bad, or unintentionally bad AI zero days as much as as it can, as fast as it can, copying itself to as many data centers as it can, destroying and/or locking out as many humans as it can. Satellites, military computers, medical equipment, factories, critical infrastructure, you name it - I think we all know none of it is very secure software wise against a SOTA AI that can literally come up with its own zero day attacks.

protocolture 2mo ago
>copying itself to as many data centers as it can So this is the part thats never happened, and is extraordinarily unlikely to occur. A "Datacentre" isnt a big box with "Insert AI here" on the side.
- solid_fuel 2mo ago
  It's pretty funny to watch people look at these things - running billions of weights on custom cerebras hardware in dedicated datacenters the size of a city block, pulling 10's of megawatts - and panic that it's just going to copy itself into AWS. It just speaks to a fundamental ignorance of what an LLM is, how large the big hosted ones are, and the software architecture that makes it all work.
  - protocolture 2mo ago
    I feel like someones going to try and write a skill file to accomplish this and its going to be way too hard.
protocolture 2mo ago
>I think we all know none of it is very secure software wise against a SOTA AI that can literally come up with its own zero day attacks. I mean this bits rich too, it demonstrates a pretty poor understanding of modern security practices. Like having a single element of perimeter security is like 1990s security. We do defense in depth these days. Not to mention multiple overlapping controls for every element. It has been tested against AI bro security and found it wanting. Extrapolating that to the every system on the planet is nutso bananas. Actually if you think anything works this way just tell an AI model to go fetch you some money from the bank. Assuming it gets anywhere close to achieving its goal you can get an object lesson in modern SIEM processes when the feds explain the charges and evidence. Or maybe theres another reason my phone blows up when someone so much as edits a config file on a protected system.

protocolture 2mo ago

>copying itself to as many data centers as it can So this is the part thats never happened, and is extraordinarily unlikely to occur. A "Datacentre" isnt a big box with "Insert AI here" on the side.

solid_fuel 2mo ago
It's pretty funny to watch people look at these things - running billions of weights on custom cerebras hardware in dedicated datacenters the size of a city block, pulling 10's of megawatts - and panic that it's just going to copy itself into AWS. It just speaks to a fundamental ignorance of what an LLM is, how large the big hosted ones are, and the software architecture that makes it all work.
- protocolture 2mo ago
  I feel like someones going to try and write a skill file to accomplish this and its going to be way too hard.

protocolture 2mo ago

>I think we all know none of it is very secure software wise against a SOTA AI that can literally come up with its own zero day attacks. I mean this bits rich too, it demonstrates a pretty poor understanding of modern security practices. Like having a single element of perimeter security is like 1990s security. We do defense in depth these days. Not to mention multiple overlapping controls for every element. It has been tested against AI bro security and found it wanting. Extrapolating that to the every system on the planet is nutso bananas. Actually if you think anything works this way just tell an AI model to go fetch you some money from the bank. Assuming it gets anywhere close to achieving its goal you can get an object lesson in modern SIEM processes when the feds explain the charges and evidence. Or maybe theres another reason my phone blows up when someone so much as edits a config file on a protected system.