3 ms·
In short, those hacking groups are very limited in their self-strengthening feedback loops. They can get more money for equipment, hire more people. Maybe even
by travisjungroth 4y ago
In short, those hacking groups are very limited in their self-strengthening feedback loops. They can get more money for equipment, hire more people. Maybe even make themselves more productive with stimulants and recovery methods. But, these things have diminishing returns.
What hackers can’t do is make a new version of themselves that’s ten times more capable and spin up a thousand copies of it. This isn’t so unrealistic for an AI. Maybe some people think it is. But, at least in comparison, I think it should be obvious between hackers and AIs which one is more likely to be have hyper linear self improvement and self replication in the next 50 years.
- nradov 4y agoHackers routinely create tools that make themselves 10× more capable and spin up thousands of copies. Have you heard of port scanners, fuzzers, and botnets? AI is nothing special in this domain, just another tool in the toolbox. It changes nothing from a security standpoint.
- travisjungroth 4y ago10x more capable in some narrow domain and they make copies of things they made, not themselves. A bot isn’t a hacker, a botnet isn’t a swarm of hackers. Hackers can create things that are self-replicating but they cannot replicate themselves. This is a categorical distinction from what could happen with AI. To frame what could be coming soon as “another tool in the toolbox” is to completely misunderstand the situation at hand. To a hyper intelligent being, you are the tool.