4 ms·
Affecting the world can happen through people the AI communicates with (people are incredibly susceptible to manipulation) and through any and all digital syste
by dinfinity 2y ago
Affecting the world can happen through people the AI communicates with (people are incredibly susceptible to manipulation) and through any and all digital systems accessible via the internet (anything that isn't airgapped, basically). If a malicious AI can hold tons of essential infrastructure hostage, it can have a lot of power and gain a lot more of it (think all the cyberattacks imaginable happening all at once and controlled by a single entity). Thinking full societal collapse or subjugation can only happen through killer robots is incredibly shortsighted, imho.
Agency is also fairly trivial. People are already creating agents with the current AIs and setting them loose in various ways. If it is not done via private industry, it will be via random malicious actors or state actors (military or intelligence).
I'm not saying we're doomed (I in fact believe that powerful AI will, at least initially, be far more inclined to not cause us to want to destroy it), but to miss how terrible outcomes due to AI _could_ occur is irresponsible, imho.
- gary_0 2y ago> people are incredibly susceptible to manipulation Many truly disastrous things have already happened due to human-generated mass propaganda (and other forms of manipulation). I agree that AI can be used as a force amplifier (and Brian points this out in his talk), but AI isn't introducing a scary new sci-fi problem, we're still just facing the same problems humanity have struggled with for centuries. And LLMs are far from the first technology to have this downside. When non-doomers say "cool it", we're not saying to ignore the already real problems AI might conceivably make worse, we're saying it's way off base to worry that we should bomb datacenters to prevent being killed by AI-controlled superweapons or eaten by gray goo.