7 ms·
> I'm not entirely clear what you are asking now Give me an actual technically feasible and sourced attack path that cannot be remediated via existing methods.
by alephnerd 2y ago
> I'm not entirely clear what you are asking now
Give me an actual technically feasible and sourced attack path that cannot be remediated via existing methods.
The issue is you are giving broad stroke handwavey assertions. The proof is in the pudding. Don't imagine the pudding, show me a step by step technically feasible recipe for the pudding.
> Also, do I misunderstand you or are you really claiming that things like electrical generating stations cannot be taken over by breaking into the computers that control them even if the "agent" doing the breaking-in is as good at breaking into computers as AIs currently are at chess, i.e., much much better than people are
I am not denying that electric grids can't be hacked (hell back in HS and College I used to try and take over IP CCTVs and other IoT devices using Shodan for lulz).
What I am dismissing is the statement that existing models today can "crack" environments by innovating new attacks.
Sure they can catch misconfigurations and brute force CVEs, but models are limited by their corpora, and much of the corpora used does not include every single pattern of code in humanity.
This is why the companies testing computer generated code are using internally trained models because each code base is unique with different idiosyncrasies. And code patterns do differ based on where you studied and worked (it's been a common tool in attributing attacks to groups).
> but you seem to have a different dismissal having to do with the difficulty of subverting computer-based systems
Because I worked in this the security and ML/HPC industry for 10-15 years in every single facet - engineering, policy, product, and funding.
Broad stroke narratives are nice, but if they cannot stand a basic stress test, then they don't make sense.
I'm sure you lesswrongers can agree with that, but you guys seem to think you're smarter than the other domain experts who are actively thinking about these problems as well, and how to minimize them in their domain.
- hollerith 2y ago>What I am dismissing is the statement that existing models today can "crack" environments. Existing models are not capable enough to take over anything. However, the labs are always trying new architectural (algorithmic) improvements to models, and some labs have announced plan to spend many billions of dollars (in electricity and hardware purchases) training a single model. (In contrast, it took less than 150 million to train GPT-4 IIRC.) Most of us (including the interviewee in the OP) who maintain that AI research is a danger to the human race maintain that most of the danger is not right now, but spread out over the next 30 years or so.
- alephnerd 2y agoI am asking for a tangible technical piece of proof. It's clouds in the sky if you don't actually give tangible step by step or empirical proof of how XYZ can arise This is just bad science fiction without that. (Edited to remove meanness and snark. Sorry about that)
- hollerith 2y agoSuppose members of an advanced alien civilization arrive in Earth orbit. Their ships are tens of miles long! "If they wanted to, those aliens could kill us all," I say. "Now that they are here, there's probably nothing we could do to stop them." You reply, "I don't see it. Give me a tangible step by step or empirical proof of how we might be killed. No generalizations!" That's hard to answer because there are many ways they might kill us. The aliens could for example announce that they are friendly, then help us by curing cancer, but the cancer-prevention elixer they distributed to us makes everyone infertile, then they wait for the last of us to die of old age. Of course, some people will refuse to consume the elixer, so the aliens would need a separate way to handle them, but it is much easier to handle a few million people than all 8.1 billion of us. Alternatively, they might alter the trajectory of the moon so that it (eventually) crashes into the Earth. Alternatively, they might remove all the oxygen from Earth's atmosphere. Maybe the aliens aren't even trying to kill us, but they don't care about us and they have some other reason to want to remove all the oxygen from the atmosphere. (Maybe they want to station some machines on Earth, and the oxygen is corrosive to the machines.)
- mewpmewp2 2y agoI described what I think could be a plausible way, but of course ASI would presumably be far smarter than me and so would have a much better plan yes. I have other comment with those steps, but roughly ASI would have to 1. Be able to clone itself, create botnets all over the World to make sure there's enough redundancy. I think that's very plausible and would be easy for it to do if it gains network access even for just a while. 2. Gain means to have control over some set of humans through blackmailing (hacking for compromised information), finance (ransomware, currently $1 billion+ market) or just simple persuasion/ideology. It would use human proxies to form physical companies to establish stronger physical presence in many countries, plant devices for hacking, etc. Probably co operate with criminal organisations, etc. The money it has made can go long way there to achieve things. 3. Once it has enough human proxies it would need to make sure that it doesn't need to rely on human proxies and then it would need to either establish its own robotics companies through proxies or hack existing robots/factories to get control over them. And during all that it might not even be clear to the proxies what they are really dealing with. The AI could make up a different background story and a pattern for each of the proxies, where each proxy wouldn't even know about each other. If ASI was to happen today, and it was truly ASI, I don't see how it can be stopped, honestly. No one would be even able to tell what is going on, since it can use encryption techniques for everything it does that differ from what humans would use, and it can diligently switch up the pattern so it wouldn't be clear that if there's a rise in cyber attacks or scams, that there's a single entity behind it. So I think no one would even know for a while what is going on, and when they do, by then it would be too late.