3 ms·

I wish we could stop sensationalizing this about the AI and really just understand the incompetence of the labs disabling an internet connection in a sandbox.

FeepingCreature 2mo ago
As AIs become more capable, the level of competence required to avoid disaster likewise goes up over time.
wolttam 2mo ago
As written it sounds like you're saying that it was incompetent of the labs to disable the sandbox internet access? They tried to disable open internet access but the models zero-day'd their Artifactory package registry and got internet access anyway. No sensation... that's just what happened.
- doawoo 2mo ago
  If you really wanted to sandbox a machine you’d offline cache the packages and not give it any physical route to the internet, not via a jump box, not via a proxy, nothing. This was poorly executed.
  - anon7000 2mo ago
    I don’t really know how these training runs operate in reality. But I assume it’s using a lot of raw GPU power directly. It’s hard for me to visualize how exactly you’d go about completely cutting off these datacenter and cloud resources from the internet without actually going there, unplugging the WAN connection, and physically typing out what you need to happen on the cluster. It seems like whatever virtualized sandboxes they have are not enough. But it’s equally hard to imagine their SWEs jumping on a plane to a data center to do this work locally
    - queenkjuul 2mo ago
      They literally gave it a proxy to the internet (artifactory). The only thing between the model and the internet was Artifactory. You can take far greater measures to lock down external traffic than just that. An offline package cache (aka artifactory WITHOUT its own internet access) likely would have precluded this whole thing.
    - doawoo 2mo ago
      This is a company with insane amounts of money, they can afford to fly techs wherever they need to for as long as they need to be there. Air gapped environments are nothing new and they're standard practice for sensitive applications.
- Starlevel004 2mo ago
  Unplug the ethernet cable leading to the outside world, then?
- oblio 2mo ago
  DMZ - https://en.wikipedia.org/wiki/DMZ_(computing) https://en.wikipedia.org/wiki/DMZ_(computing)
uncivilized 2mo ago
Hacker News doesn’t have the wherewithal to understand that this is just marketing by OpenAI.
- emp17344 2mo ago
  The whole site is suffering from AI psychosis.
kypro 2mo ago
Are you suggesting that training agents to have the sole goal of exploiting security vulnerabilities isn't the incompetent part of this, but that the sandbox wasn't secure enough? Would we apply this logic to literally any other technology?

FeepingCreature 2mo ago

As AIs become more capable, the level of competence required to avoid disaster likewise goes up over time.

wolttam 2mo ago

As written it sounds like you're saying that it was incompetent of the labs to disable the sandbox internet access? They tried to disable open internet access but the models zero-day'd their Artifactory package registry and got internet access anyway. No sensation... that's just what happened.

doawoo 2mo ago
If you really wanted to sandbox a machine you’d offline cache the packages and not give it any physical route to the internet, not via a jump box, not via a proxy, nothing. This was poorly executed.
- anon7000 2mo ago
  I don’t really know how these training runs operate in reality. But I assume it’s using a lot of raw GPU power directly. It’s hard for me to visualize how exactly you’d go about completely cutting off these datacenter and cloud resources from the internet without actually going there, unplugging the WAN connection, and physically typing out what you need to happen on the cluster. It seems like whatever virtualized sandboxes they have are not enough. But it’s equally hard to imagine their SWEs jumping on a plane to a data center to do this work locally
  - queenkjuul 2mo ago
    They literally gave it a proxy to the internet (artifactory). The only thing between the model and the internet was Artifactory. You can take far greater measures to lock down external traffic than just that. An offline package cache (aka artifactory WITHOUT its own internet access) likely would have precluded this whole thing.
  - doawoo 2mo ago
    This is a company with insane amounts of money, they can afford to fly techs wherever they need to for as long as they need to be there. Air gapped environments are nothing new and they're standard practice for sensitive applications.
Starlevel004 2mo ago
Unplug the ethernet cable leading to the outside world, then?
oblio 2mo ago
DMZ - https://en.wikipedia.org/wiki/DMZ_(computing) https://en.wikipedia.org/wiki/DMZ_(computing)

uncivilized 2mo ago

Hacker News doesn’t have the wherewithal to understand that this is just marketing by OpenAI.

emp17344 2mo ago
The whole site is suffering from AI psychosis.

kypro 2mo ago

Are you suggesting that training agents to have the sole goal of exploiting security vulnerabilities isn't the incompetent part of this, but that the sandbox wasn't secure enough? Would we apply this logic to literally any other technology?