12 ms·
We are in the multilayered race between - The risk of the rise of AGI - The risk and madness of Nuclear conflict - The risk of runaway Climate change My mon
by belter 3y ago
We are in the multilayered race between
- The risk of the rise of AGI
- The risk and madness of Nuclear conflict
- The risk of runaway Climate change
My money is on Mother Gaia. She will brutally and swiftly discipline her puppies.
- wafriedemann 3y ago[flagged]
- wafriedemann 3y ago[flagged]
- aeonik 3y agoAGI will likely want low noise circuitry, so at least a rogue AI overlord would likely be aligned with the other two objectives. Can't have high intensity radioactive and thermal noise messing with those world dominating algorithms.
- 127 3y agoOr maybe AI will just nuke humans to fix climate change.
- gessha 3y agoAh, good ol Gandhi strats
- dangus 3y agoI feel AGI and nuclear conflict have zero relevance to this article. I also personally think the risk of nuclear conflict is pretty much zero.
- EGreg 3y agoYou’re pretty much alone in that
- pfdietz 3y agoI don't know about that; I could see everyone drifting into a conflict no one wants, WW1 style. Recent events also are incentivizing small countries to go nuclear, which will increase the risk of nuclear war. I expect South Korea, Japan, and maybe even the Philippines and Vietnam to acquire nuclear weapons at some point. Japan already has a capability to acquire nuclear weapons quickly, with their separated reactor-grade Pu stockpile.
- oldpersonintx 3y ago[dead]
- dangus 3y agoAcquiring nuclear weapons is not the same as using them. Nuclear weapons aren’t a combat armament. They are an insurance policy. They are a way to get adversaries to leave you alone or bring you to the negotiating table. I believe it was Kim Jong Il or Un or maybe both who directly stated this to insiders in their regime. They weren’t ever intended to be used, and those leaders were fully aware that any real conflict would result in their regime’s annihilation. Their #1 goal was preservation of their family monarchy. Nuclear war is the opposite of that. Source: https://www.imdb.com/title/tt9169656/ https://www.imdb.com/title/tt9169656/
- pfdietz 3y agoThe argument "war won't occur, it's irrational" isn't a good one. Both WW1 and WW2 were irrational, but they happened anyway. If actors were perfectly rational no wars would occur.
- AtlasBarfed 3y agoPutin is backed in a corner. You are praying their arsenal isn't launch capable anymore.
- actionfromafar 3y agoI'd put a higher risk number of nuke throwing starting between smaller countries, like Pakistan, or Iran. Putin strikes me as more like a coward than suicide bomber.
- b112 3y agoPutin is quite old and will die soon. My concern is the chaos which follows, as Putin has killed all strong contenders for power. It shows how little he cares, for the best thing a leader can do for a nation is to ensure a strong successor. The resulting civil war in Russia is where the nukes may appear. Anyhow,
- AtlasBarfed 3y agoHonestly I wonder if a lookalike will simply continue on. I know it's conspiratorial but Putin has looked a lot healthier.
- api 3y agoThe risk of global thermonuclear war is low since it would require one of the major powers to go suicidally mad. The risk of local or regional nuclear conflict as part of a larger scale war is high.
- swader999 3y agoWe all work in complex systems and see first hand how fragile and error prone they are. Yet you think the risk of nuclear war is low even though the programs rely on similar types of systems?
- TeMPOraL 3y agoHuman-driven systems, embedded in the real world, are still inefficient enough[0] that they are much more resilient than the kind of systems we work with. At the very least, each part of the system has the ability to independently evaluate the process they're a part of, and stop it in its tracks if they think a fatal mistake is about to happen. See e.g. Stanislav Petrov and be thankful his job wasn't automated, or we'd not be here to talk about it. -- [0] - Which, in this context, is a good thing.
- c048 3y ago'Mother' Gaia will wipe all complex life from this planet with 1 to 1.5 Billion years if her 'undisciplined' puppies don't find a way to leave this ball of dirt. She's also got quite a lead with killing off 99.99999% of all species that ever lived, when compared to us.
- BirAdam 3y agoSounds like a challenge for which our species is well suited.
- deleted 3y ago[deleted]
- gmd63 3y agoEveryone hell bent on leaving is actually distracted from the real less immediately glamorous challenge, which is learning to sustain life and exercise restraint.
- andybak 3y agoI think the point is that we need both. One is short/medium term and the other is medium/long term. An asteroid/comet impact big enough to wipe us out is a statistically certainty - not science fiction.
- itsoktocry 3y ago>Everyone hell bent on leaving is actually distracted from the real less immediately glamorous challenge, which is learning to sustain life and exercise restraint. Unless you're willing to exterminate people who don't comply, the incentives are such that maintaining the status quo will give economic (and military) advantages. Besides, over long time scales there's more to fear than a few degrees of climate change.
- saagarjha 3y agoThere are plenty of things that give economic and military advantages that we thwart.
- KingOfCoders 3y agoMother Gaia does not care about anything.
- shrimp_emoji 3y agoMother Gaia is a dirty bitch![0] 0: https://youtu.be/75_nisowGX8 https://youtu.be/75_nisowGX8
- AlexandrB 3y ago#1 is marketing hype. #2 is very real. #3 is happening and could cause #2 if wars for livable land and water resources break out.
- aurareturn 3y ago#1 is very real #2 is warmongering #3 will be solved by human ingenuity I have a more positive outlook. :)
- tomrod 3y ago#1 is a pipe dream. Oauth2 token TTL expiration alone will limit infiltration :-)
- belter 3y agoUnderrated comment :-)
- IMTDb 3y ago#1 is marketing hype #2 is warmongering #3 will be solved while trying to reach #1
- belter 3y agoRecent "Star Trek Picard" episode... Data: We are going to die. Geordi La Forge: Data...You are being negative again. Say something positive! Data: I hope we die quickly!
- globalnode 3y agoThat should be the slogan for the in-coming climate and viral disasters.
- jeromegv 3y ago> #3 will be solved by human ingenuity It already started, billions of dollars in losses, with no real solution in sight.
- hsavit1 3y agoYou don’t understand the enormous immediate risk of climate change if you think that AGI is a comparable risk. Climate change is now and is killing people every day
- the_third_wave 3y ago[flagged]
- cduzz 3y agoAnd climate change is now making many more people wealthy than AGI has and potentially ever will. Reverse Carbon Sequestration employs a very large population.
- olalonde 3y agoClimate related deaths are at an all time low...[0] [0] https://twitter.com/HumanProgress/status/1634509546067574790 https://twitter.com/HumanProgress/status/1634509546067574790
- duozerk 3y agoAh yes, a "source" from Charles Koch's Cato Institute. Do you really expect to be taken seriously with this "rebuttal" ?
- olalonde 3y agoHere's another source using data from the "EM-DAT International Disaster Database"[0]. Excerpt from the article[1]: > As we see, over the course of the 20th century there was a significant decline in global deaths from natural disasters. In the early 1900s, the annual average was often in the range of 400,000 to 500,000 deaths. In the second half of the century and into the early 2000s, we have seen a significant decline to less than 100,000 – at least five times lower than these peaks. This decline is even more impressive when we consider the rate of population growth over this period. When we correct for population – showing this data in terms of death rates (measured per 100,000 people) – then we see a more than 10-fold decline over the past century. [0] https://www.emdat.be/ https://www.emdat.be/ [1] https://ourworldindata.org/natural-disasters https://ourworldindata.org/natural-disasters
- kylebenzle 3y ago1. AGI doesn't even exist and Sam Altman and I agree on one thing, GPTs will not get us there. Saying AGI is a risk is like saying the sun exploding is a risk. 2. Nuclear conflict is real, it's astounding Pakistan or Russia hasnt used the bomb yet but they will when the US backs them into a corner. 3. Climate change? At this point, who cares? We know it's happening and happening VERY slowly so we have PLENTY of time to get ready. Theres no real risk other than failing to move away from the cost in the next 100 years. International shipping and big ag are the largest polluters by far and those ain't stopping.
- huygens6363 3y agoFear of AGI is not based on Altman’s latest brews. Look at the progress curve of AI in general is one way to get a feeling for it. The other one, which I prefer, is looking at existing AIs for which we thought human ingenuity was top notch and how they are beating us left and right. Strategy, creativity, cunning, all human notions that are being slaughtered. Slowly, but surely. It is “just” a matter of combining. I think it’s an “engineering problem” by now. Which is not to say that it will happen soon, just that if we set our minds to it it won’t be that big of a deal.
- blueflow 3y agoI'm patiently waiting for my sysadmin job to be automated away. AGI, its time to deliver! I'm waiting. Should have happened yesterday?
- TeMPOraL 3y agoThe only AI remotely generic enough for that exists for like 2 years. Give it a few more, you might just get your wish.
- kylebenzle 3y agoMaybe.
- 3y ago
- srackey 3y agoIf you stop looking at the internet it immediately becomes clear nothing is happening. Apocalyptic thinking is not the mark of a healthy mind.
- morkalork 3y agoLetting off a few nukes could slow climate change a bit right? I vaguely recall that all the dust kicked up by the hundreds of tests in the 50s and 60s had an effect.
- adrianN 3y agoIt works best if the nukes hit densely populated areas, but I hope we manage to implement the solutions to climate change that don’t require killing billions.
- sushibowl 3y agoPossibly, but you have to keep doing it. kicking up dust into the atmosphere tends to have significant short-term impact on the global climate (see e.g. volcanic winters: https://en.wikipedia.org/wiki/Volcanic_winter https://en.wikipedia.org/wiki/Volcanic_winter). Then the dust settles shortly and everything returns to normal. But volcanic eruptions that cause a winter like that tend to be quite a bit more powerful than your average nuclear weapon. More importantly, not all dust is created equal. Sulphur containing compounds tend to have the biggest cooling effect. One neat (in a terrifying sort of way) geo-engineering idea is continuously injecting large amounts of sulphur dioxide into the stratosphere.
- deleted 3y ago[deleted]
- triceratops 3y agoDrop a nuke into a volcano /s
- unicornhose 3y agoMorbidly curious what would actually happen in this scenario.
- Filligree 3y agoYou’d create a lot of body thetans.
- jibbit 3y agonow theres a list that "antibiotic resistant bacteria" fits into quite nicely
- zeckalpha 3y agoThis is the polycrisis.
- jmyeet 3y agoI'm not that worried about nuclear conflict because it's a scenario where literally nobody wins. There's always the "Madman" hypothesis but really that's no way to do geopolitical analysis. Nobody is truly "crazy" (IMHO). Remember those orders have to be carried out by someone. They've studies on this with missile silo operators and they had a disturbing or comforting (depending on your POV) tendency to not launch. It's really the "slow death" scenarios that are a much bigger risk. While I'm firmly in the AGI camp, I'm both fatalistic about our willingness to do anything about it but I'm also highly skeptical of the "runaway climate change" doomsaying. The Earth has been around for ~4.5 billion years. While it's only been similar to what it is now for th elast 300 million or so, that's still a really long time. We've had periods where ice extended to the equator (~500 million years ago). We've had much warmrer periods. The Earth will be fine. We however might fall by the wayside. There's really been such a long period of time that if runaway climate change were going to happen, why hasn't it happened already?
- darksaints 3y agoReally? You’ve never met someone with the “if I can’t have it, nobody can” mindset? Never heard of a custody dispute where the losing parent kills the kids in order to deprive the other parent of them? Vladimir Putin is exactly that kind of person. When backed into a corner and knowing he will die, he would rather nuke the whole world than accept his fate. And those orders will be carried out by people in heavily restricted information silos, who only have the explanation of their commanding officers as reasoning. For all they know, this is a test, or the US already has launched their nukes, or if they don’t launch the nukes their mom will be dropped out of a window.
- jmyeet 3y agoSo this is a learning opportunity for the differences between "idealism" and "materialism". "Idealism", which unfortunately underpins all mainstream political discourse, is simply that certain actors (people, states, etc) are good because they're good or they're bad because they're bad. It's really the Marvel view of the world. There are good guys and bad guys. Idealism is a completely inadequate way to view the world because it simply reflects the propaganda that's effectively sold the idea of who the good guys and bad guys are. "Materialism" is a broadd term that originates in the philosophy that people affect the material world and the material world affects people. More specifically to this point, it's the idea that people do things for a reason. That doesn't mean the reason is justified or sound or good. But there is a world view that underpins any actions by any actor. So when it comes to wars, the idealist will say one side are the good guys and the other side are the bad guys and never go any deeper than that. The materialist will derive that all wars come down to the desire for resources and land. Not religion. Not ethnicity. Those are simply pretexts to motivate the citizenry and foot soldiers. So Putin dons the Duganist [1] hat, just like European kings in the Crusades wrapped themselves in Christianity. Putin may even be a true believer but that's not why he's doing what he's doing. He's securing a land bridge to Crimea, a warm water port on the Black Sea and control of territorial waters in the Black Sea and the resources contained therein. He probably figures the West will eventually lose interest (which is already happening) and in the mean time he can keep selling oil and gas to China and India so the sanctions are inconvenient but can be weathered. There's nothing crazy about it. But even if he was crazy, to launch a nuclear attack, someone would have to carry out those orders. Bomb loaders, generals, submarine commanders, pilots, missile silo operators, etc. Look up the history of Vasily Aleksandrovich Arkhipov. [1]: https://ens0.medium.com/what-is-duginism-71f44a652658 https://ens0.medium.com/what-is-duginism-71f44a652658
- Jun8 3y agoOn the topic of “Mother Gaia” being a bloodthirsty bitch (how we humans like to anthropomorphize rather than grasp things as they are) see Tiptree’s excellent story: https://en.m.wikipedia.org/wiki/The_Last_Flight_of_Dr._Ain https://en.m.wikipedia.org/wiki/The_Last_Flight_of_Dr._Ain. We may have come close to this being reality four years ago perhaps.
- padjo 3y agoClimate change is analogous to a scenario we see all the time in nature i.e. a species finds massive success causing its population to spike, this population spike degrades the supporting environment and the species risks extinction. We dodged this in the 20th century with the green revolution but the risk remains. We still haven’t figured out how to live within the limits of our environment, instead we continue to extract from it and degrade it. If we don’t figure this problem out then our species is done for. Compared to this the other two are barely even risks.
- soulofmischief 3y agoThe other two are really only risks if the climate change risk doesn't take us out.
- Night_Thastus 3y ago#1 isn't happening anytime soon, nothing we have is on a path in that direction. #2 people always worry about, but it's almost certainly not going to happen - insane dictators or no. Even in much worse scenarios we avoided it. #3 Real, but slow. I think we'll see some coastal communities devastated over the course of the next ~50 years, but the rest of the world will adapt and/or sweep it under the rug as best they can. The bigger threat is economic. Companies will no doubt try to use the changing situation as an excuse to skyrocket prices and keep everyone broke.
- jonwinstanley 3y agoIncrease of both droughts and floods mean we have issues inland too
- baq 3y agodroughts are here now and will get worse in the coming decade. the amount of energy required to melt ice sheets (if that's what you're alluding to) is extremely huge and while it is certain they'll melt in a business as usual scenario (and possible if we stopped all emissions now...), it'll take hundreds if not thousands of years to get there. whereas extreme droughts are here today, now, as we speak.
- mywittyname 3y ago#2 People aren't evaluating this risk correctly. If the war in Ukraine has taught me anything, it's that the assertions, "Putin would never do..." is wrong. #3 The real risk is the refugee crisis. The world is going to be split into two groups: refugees, and those trying to keep the refugees away. Large countries are going to experience crises from both internal and external migration. Think, people from mexico flooding into texas, while people from Texas flood north into the great plains. It's going to happen slowly, then all at once.
- Night_Thastus 3y agoThere's a big difference between an invasion and launching nukes. There is no amount of reparation, apologies, victim blaming, empty promises, propaganda, etc. to un-do a nuke. Putin wants to remain in power - which doesn't happen if there's no country left to govern.
- alfor 3y agoCO2: slow, decades, centuries AI: fast, month to years and exponential Nuclear: risky but has been with us for 70 years already Conclusion: climate change is not a real concern, tech will improve so much in the next decade as to make all our assumptions obsolete.
- willyt 3y agoYou forgot the H5N1 with 50% mortality rate raw milk thing. There is an article on Ars about raw milk drinkers actively seeking infected milk in the belief it will immunise them against H5N1. I’m not a biologist but this feels like it could be very dangerous to everyone.
- jpadkins 3y ago1) Is real but will have net positive impact on humanity (of course there will be losers, but like most new technologies humans will have more for less effort) 2) It is real but unlikely to end humanity. Much more likely to create large areas that are unlivable, but a lot of work has gone into avoiding world ending scenarios. 3) Is mostly hype. Doom predictions in the last 20 years on this topic have been very wrong. The climate is always changing, and humans will have to adapt as always (+1 to 2C increase over 100 years is not world ending). The long term problem will be prevented by a) running out of cheap carbon based energy b) geo-engineering c) rise of cheaper non carbon based energy (related to a). Asteroid impact or pandemic / virus / man-made bioweapon are all higher probability humanity ending risk IMHO. Not enough thought & energy are put into those scenarios.
- jtolds 3y agoHow can this be such a top-voted answer? What? Without even going into the unsubstantiated assertion with #1, your comment on number 3 shows a dramatic misunderstanding of how compounding effects work. You can't use the last 20 years to linearly project like this. It is true that most scientists agree that humanity will likely not go completely extinct, but it is also true that most scientists agree that many, many individual humans will be impacted. It is tough to say just exactly how humans will be impacted, but think famine, war, major societal upheaval. Here's a citation if it helps: https://academic.oup.com/bioscience/article/71/9/894/6325731 https://academic.oup.com/bioscience/article/71/9/894/6325731
- mike_hearn 3y agoHe said 20 years of doom predictions that haven't come true. Compounding effects don't apply to the accuracy of academic predictions. It's not like academic accuracy automatically gets exponentially better over time. Linear projection when attempting to guesstimate the accuracy of future predictions by a group of people who have also made predictions in the past is a fairly reasonable thing to do, unless you have some specific evidence that they significantly improved their methodology. Your citation is merely an advocacy piece, not science. For example the first diagram contains charts of fertility rates, institutional assets divested and world GDP whilst claiming they are "climate related human activities". Presenting a nearly random collection of metrics as evidence for your argument isn't a sign of robust thinking or argumentation.
- darby_eight 3y ago> The risk of the rise of AGI can someone explain what the risk of this actually is? I just assumed it was a regulatory capture ploy. IMO it is massively distracting from the very real and very measurable impact the global industry has on our climate.
- kypro 3y agoI understand why some people might not weight the probability and risk of AGI as highly as others, but to deny the risk entirely, or to act as if it's ridiculous to be concerned about such things in my opinion is just an intellectually ignorant position to hold. Obviously near-term AGI and climate change present us with near zero risk, and therefore certain groups will dismiss both. This is despite clear trends plotting towards very clear risks, but because these individuals are yet to see any negative impact with their own eyes it's all too easy for them to dismiss the risk as some kind of hysteria. But these risks are real and rational because the trends are real and clear. We should take both seriously. The nuclear risk is real too, but unlike AGI and climate change the risk isn't exponentially increasing with time. I think other weapons like bioweapons and drone weapons potentially fit that risk profile, however.
- darby_eight 3y ago> deny the risk entirely, or to act as if it's ridiculous to be concerned about such things in my opinion is just an intellectually ignorant position to hold. This would take someone actually articulating what this risk you refer to is. All I have to go off of is Terminator, which is patently ridiculous. People in power would never relinquish this power to a computer without being able to dictate whom it benefits.
- EasyMark 3y agoGaia isn't really a thing. There are only natural processes, chemistry, and physics, and there is definitely nothing motherly about them; they are ruthlessly efficient.
- deepfriedchokes 3y agoIf that is true of Gaia then that is true of you as well.
- bufferoverflow 3y agoTemperature problem can be solved relatively easily and cheaply by putting a bunch of reflective film all over the planet (mainly deserts). Getting CO2 out of the atmosphere is actually expensive. But we will have to do it. High concentrations of CO2 reduce IQ and make humans actually uncomfortable.
- shrimp_emoji 3y agoWe are not at risk of runaway climate change. That's a common misconception and a convenient scare tactic. We're also not at risk of runaway AGI any time soon. LLMs are a joke. Minds are computationally irreducible, and all our supercomputers can barely hold a baby fruit fly's connectome. Unless you mean biological AGI. We're going to figure out genetic engineering far sooner than we'll get the hardware necessary for inorganic AGI. Once we master biology, we can genetically engineer organic super intelligences or, far sooner, superviruses whose genome can be uploaded into a nucleotide synthesizer in someone's garage. Then it's game over. Unless we've colonized Mars (which also helps with nuclear conflict).