4 ms·
All technologies live on some scale of exploitability. Mobile phones, for example, are somewhere on that spectrum, and google and apple try their best to secure
by rozap 2y ago
All technologies live on some scale of exploitability. Mobile phones, for example, are somewhere on that spectrum, and google and apple try their best to secure them. But there are still state actors that have really sophisticated attacks that worm their way into devices. To be clear, I think the security teams at google and apple shouldn't throw their hands up and give up, but I think you need to be honest with yourself when building capability, to accept that it'll get misused. If the misuse doesn't outweigh the benefit to humanity, then it's pretty easy to sleep at night. If it does, then I think you have to wrestle with some awkward questions.
On the scale of exploitability, I think some of the LLMs we have now are pretty high up there, beyond mobile phones - harder to secure and with bigger consequences when misused. The intelligence agencies of pariah states like Russia, Iran and Israel will absolutely use this stuff to sway public opinion and get large numbers of people killed. I think employees of OpenAI need to be honest with themselves about this, rather than deluding themselves and saying "oh we'll just do security/trust/safety" better than the a nation state.
I think there are a number of ways out of this which are consistent. You could convince yourself that AI's benefit to humanity as a whole over time will outweigh these issues now [citation needed], or you could take a nihilistic approach and say that you just wanna print stacks of money and go relax on the beach. Those are at least arguments you can make. But I think it's intellectually dishonest to say "Bad stuff won't happen with our tech because our team will out compete the mossad".