2 ms·
This is why "AI safety" is a complete joke to these companies.
by rvz 16d ago
This is why "AI safety" is a complete joke to these companies.
- verdverm 16d agothey're all using the same vendor, re: incestuous EA cabal
- talon8635 16d agoWell, to be fair, isn’t it an unsolved question? Are they constructing sandboxes, signaling intent to be safe, but their own models are smarter than their internal security team building the sandbox?
- arcfour 16d agoAs a security engineer I have no idea why these sandboxes would even be connected to the internet at all for tasks that aren't intended to use the internet. A package proxy? Why not run our own internal cache? Then we aren't at (as great a) risk of someone poisoning it with a malicious package during model training, for example...
- borski 16d agoWe’re hiring. :) (And we’re fixing many of these things, but worth noting this happened at a third party vendor, not in our lab)
- xnx 16d agoCould you add any detail on why Google uses (used?) Irregular? I wouldve thought that type of service would be a core competency that Google needs internally.
- borski 16d agoEven if you had it internally (which we do), there is so much surface area and it’s such a novel space that you’d want as much testing on it as possible. There aren’t many vendors, and irregular is one.
- eli_gottlieb 16d agoAFAICT one fundamental issue is that they don't seem to have hired actually security engineers or experts to do any actual security.
- talon8635 16d agoThey are hiring philosophers and therapists to psychoanalyze the things. It’s just absurd to assume that they aren’t hiring top notch security engineers. They made mistakes, obviously, but people are so conspiratorial these days that they just assume unlikely things off the jump.
- eli_gottlieb 15d agoNo, I think they didn't hire proper security engineers because they just don't understand what that means. Incompetence, not malice.
- pixl97 16d agoBecause they got complacent only having incompetent AIs. Real life is like reading a fiction story where a group of people are trying to prevent an unfolding disaster. The crazy thing is they already have the instructions on how to prevent the disaster. And they go on to ignore the instructions and with every step make the problem worse. Most people would put it down as being too cliche.
- danpalmer 16d agoAll of the "hacks" (from Google and others) were the same issue – the vendor Irregular running the models unsandboxed.