3 ms·

What they should have is a separate network full of honeypots which they use for this, and that they run an operation to train models to identify intrusion atte

by mosura 3mo ago

What they should have is a separate network full of honeypots which they use for this, and that they run an operation to train models to identify intrusion attempts in real time based on the resulting data. As you said though, that wouldn’t have the desired effect.

andai 3mo ago
You mean a fake copy of the entire internet? Well they already scraped it all! Heck, they can use Cerebras to generate HTTP responses dynamically!
elif 3mo ago
How do you hide the fact that they are honeypots from a super intelligence?
- mosura 3mo ago
  It doesn’t behave like a super intelligence because it is not. One of the key strengths agents have is they just keep going and going, and for cyberattacks that is often unreasonably effective. It is like a barely more aware fuzzing.
- embedding-shape 3mo ago
  These tools literally can only do what you give them access to, give them access to general tools like a linux shell and they can access to everything that comes with that obviously. The security industry figured out sandboxing and isolation a long time ago. You wanna be 100% sure it doesn't break out on open internet? Run it on a airgapped machine and don't give it network connections. OpenAI is (sadly) demonstrating they aren't responsible nor knowledgeable enough to actually run these experiments. Asking a agent harness to try whatever it wants to achieve some results, without guardrails, while running in lightweight isolation on 3rd party infrastructure? Feels like they didn't even try, people should be held responsible for this.
- nvme0n1p1 3mo ago
  We can cross that bridge once we have a super intelligence to worry about.
  - 0xDEAFBEAD 3mo ago
    If the superintelligence thinks way faster than you, you'll want to be well prepared in advance.
    - mosura 3mo ago
      If a superintelligence exists you will not be very concerned about network security because it won’t be your problem.

by mosura 3mo ago

andai 3mo ago

You mean a fake copy of the entire internet? Well they already scraped it all! Heck, they can use Cerebras to generate HTTP responses dynamically!

elif 3mo ago

How do you hide the fact that they are honeypots from a super intelligence?

mosura 3mo ago
It doesn’t behave like a super intelligence because it is not. One of the key strengths agents have is they just keep going and going, and for cyberattacks that is often unreasonably effective. It is like a barely more aware fuzzing.
embedding-shape 3mo ago
These tools literally can only do what you give them access to, give them access to general tools like a linux shell and they can access to everything that comes with that obviously. The security industry figured out sandboxing and isolation a long time ago. You wanna be 100% sure it doesn't break out on open internet? Run it on a airgapped machine and don't give it network connections. OpenAI is (sadly) demonstrating they aren't responsible nor knowledgeable enough to actually run these experiments. Asking a agent harness to try whatever it wants to achieve some results, without guardrails, while running in lightweight isolation on 3rd party infrastructure? Feels like they didn't even try, people should be held responsible for this.
nvme0n1p1 3mo ago
We can cross that bridge once we have a super intelligence to worry about.
- 0xDEAFBEAD 3mo ago
  If the superintelligence thinks way faster than you, you'll want to be well prepared in advance.
  - mosura 3mo ago
    If a superintelligence exists you will not be very concerned about network security because it won’t be your problem.