3 ms·
> But suppose AI is “only” a normal transformative technology, no more important than electricity, automobiles, or computers. That's the weak point of this art
by crazygringo 4y ago
> But suppose AI is “only” a normal transformative technology, no more important than electricity, automobiles, or computers.
That's the weak point of this article.
Because the article then goes on to admit:
> The most consequential “races” have been for specific military technologies during wars; most famously, the US won the “race” for nuclear weapons. America’s enemies got nukes soon afterwards, but the brief moment of dominance was enough to win World War II.
And basically the fear is that AI is going to be exactly like nuclear weapons in terms of delivering an overwhelmingly decisive advantage, and that this could very much be concrete reality specifically in a war where China invades Taiwan.
In everything from integrating millions of information sources to determine best strategy and tactics, to controlling swarms of smart drones and bombs and missiles.
If there were ever a moment to compare something to a technological race like the nuclear bomb, I'd say AI fits it to a tee.
- inglor_cz 4y agoWar in Europe was won before nukes were deployed. War in the Pacific would have been won by conventional means too - it would have taken longer, with more casualties, but there was no chance for Japan to fight the US and the USSR, which declared war on Japan in August 1945, to a stalemate. What would have looked different would be the political outcome. If USSR moved its armies to the East to fight Japan, well, entire Korea and half of Japan could have become Communist. On the other hand, with the Soviet Army engaged in the Far East, countries like Poland, Hungary and Czechoslovakia could have plausibly wrestled themselves free from the Soviet grip.
- majormajor 4y agoI think something like "what if Germany had gotten nukes before the end of the war in Europe, and before the US" is a more interesting counterfactual than the US not getting nukes before the end of the Pacific war. Or Russia or another European country, to a lesser extent.
- Yoric 4y agoIt is true that both Germany and the US considered it a race. However, as it turns out, by the end of the war, Germany was actually pretty far from even seeing the finish line. For some reason, murdering or driving away many of your brightest minds because they happen to come from the wrong branch of the religious tree/diverge from the mainstream sexual orientation/don't adhere to the political cult in power doesn't help come up with breakthroughs in fundamental sciences.
- inawarminister 4y agoYep, on the other hand, the US rival right now while a bit tyrannical, is actually in the similar tier to American academia; maybe a few months or even weeks behind. And lots of people in the unaligned* world is ready to switch from San Fransisco to Beijing if the latter provides cheap LLM for commercial purposes. * In the human sense of the world
- Yoric 4y agoThat is a good point. By opposition to the West, which has counted for 30+ years on banking as its main source of power, China has managed to bet on pretty much everything else, including huge investments in academia.
- jandrese 4y agoI think the "Japan surrendered because they were afraid of Russia" is revisionist history. Japan knew that Russia had no effective way to project power onto the Japanese home islands, the Russo-Japanese war had proven that and they were clearly exhausted from fighting the Nazis. Russia saw the writing on the wall and wanted to claim a piece of the pie before Japan's inevitable surrender. The only way it hastened the end of the war was in convincing the Japanese leadership to hurry up and sign the papers before any other countries declared war and made claims.
- inglor_cz 4y ago"Japan surrendered because they were afraid of Russia" I didn't make that claim. But the USSR at the end of WWII was a force to reckon with anyway. They were certainly able to invade Sakhalin (and they indeed took the southern half of it) and destroy Japanese armies on the mainland. I don't know enough about contemporary Soviet naval ability in order to judge if they were able to "island hop" from Sakhalin to Hokkaido and Hokkaido to Honshu. The stretches of water between the islands aren't very challenging in summer, but Hokkaido was very undeveloped at that time, so it is possible that lack of roads would stop the advance more efficiently than the sea.
- bryanlarsen 4y agoThe article has both "suppose it is a normal transformative technology" and "suppose it's not". It's a decision tree supporting the argument for a pause on AI research. If it's a normal transformative technology, then a pause won't hurt because it's not a race. If it is not, then if it is non-aligned it has huge potential for catastrophe. Therefore a pause is essential to ensure that we end up with an aligned AI rather than a non-aligned one. Choice A: pause won't hurt. Choice B: pause prevents destruction of the world.
- crazygringo 4y agoBut it's not just these two options. I'll take Choice C: alignment is a largely hypothetical problem that probably won't be a major issue at all, while an authoritarian China gaining an insurmountable military advantage would be a here-and-now disaster for those of us who value democracy and self-determination globally. So I'm more concerned about a worryingly realistic problem (China gaining military dominance over the West due to winning an AI race) over a totally hypothetical idea that we're going to reach some kind of singularity where non-aligned AI destroys humanity. If we start getting to a point where a non-aligned AI singularity seems to be a year or two away (or even a couple of months) then yes, shut it all down -- the same way you'd shut down a nuke that turned out to be able to obliterate the entire planet. But right now the singularity is entirely in the realm of science fiction and futurist philosophers. So right now, yes AI does look like a race, and it's important that democracy win that race rather than authoritarianism.
- om2 4y agoSo you think AI will both be overwhelmingly powerful, but also very easy to control reliably? It seems the scenario where C applies implies both of those things, because China only gets an insurmountable advantage if they can build powerful AI but also remain in control. Even today's state of the art chatbots seem pretty hard to control, and they are much less powerful than true AGI so I'm kind of skeptical.
- crazygringo 4y ago
- boringuser2 4y agoAI is more decisive than nuclear bombs, it's more akin to inventing a nuclear bomb for literally everything rather than just killing lots of people.