3 ms·
More than one thing can be true. OpenAI was absolutely negligent, but this was only able to happen because the models were capable and persistent, and had a ten
by aesthesia 5d ago
More than one thing can be true. OpenAI was absolutely negligent, but this was only able to happen because the models were capable and persistent, and had a tendency to go far beyond any reasonable boundaries. And, importantly, OpenAI's level of negligence here is pretty common. It's not hard to imagine what could happen if similarly capable and inclined models were generally available, and someone yolo'd them into a swarm to complete some other difficult-to-impossible task.
- defgeneric 5d agoI'm already seeing higher than normal attempts on my own systems, much higher than the usual scanners and background noise. Security will just need to improve. The cat is out of the bag, and letting them turn their negligence into regulation will not improve security at all.
- lokar 5d agoExactly. Any threat that already exists won’t be reduced by a cartel. The bar for connecting to the internet (safely) has gone up, a lot. It’s not going back down.
- aesthesia 5d agoI would rather not turn the internet (or the rest of existence) into a dark forest if we can help it. Are you sure that's not preventable?
- defgeneric 5d agoYes, the cat really is out of the bag. There are millions of downloads of highly capable models already out there, distributed far and wide. There's no going back at this point.
- bobthepanda 5d agoI mean really we need to address the root cause which is that OpenAI, even with what is by all accounts massively negligent, will face little to no repercussions from the event; definitely not under current regulators, and probably not anything satisfactory through the legal system. Compare this to, say, Boeing and the 737MAX fiasco; from the outside looking in, Silicon Valley has been pretty cavalier about liability and negligence, and the rest of the US is fast losing patience with that fact.
- kdmoyers 5d ago> More than one thing can be true Exactly. It is horribly dangerous AND regulatory capture benefits them. Both things.
- aesthesia 5d agoI don't get this take. They have something horribly dangerous, but regulating it might benefit them in some way, so therefore we should do nothing?