2 ms·
> There is a universe where AI models continue to improve until they eclipse humans at all cognitive tasks > what would be the best course of action based on w
by bigyabai 1y ago
> There is a universe where AI models continue to improve until they eclipse humans at all cognitive tasks
> what would be the best course of action based on what we know?
If you hold both these statements as a contingency, then the best course of action is to wait for superhuman intelligence to exist and ask it for advice. By the definition of the scenario, human-level intelligence won't be sufficient to outsmart the AI. Any ad-hoc response you get can be refuted with "what if the AI sends dinosaurs with lasers after you" and we all have to shrug and admit we're beat.
And truly, you could answer this with anything; learn to fly a helicopter, subsistence farm, start purifying water, loading gun cartridges or breeding fish. We do not know what will save us in a hypothetical scenario like this, and it's especially pointless to navel-gaze about it when with absolute certainty global warming will cause unavoidable society-scale collapse.
- atleastoptimal 1y ago>with absolute certainty global warming will cause unavoidable society-scale collapse Is that really 100% certain? Like more than 95% certain? If superintelligent AI came before society-state collapse due to global warming it certainly could find a way to stop it (if it cared about the biosphere). Even without superintelligent AI people claim that stratospheric aerosol injection could lower surface temperatures.
- bigyabai 1y ago> If superintelligent AI came before society-state collapse due to global warming it certainly could find a way to stop it How do you know? "Certainly" is an awful lot of confidence for something you've never seen or even credibly proved exists. Unless you are (or personally know) a superintelligent AI, I don't think you have the credibility to assume that's feasible. Perhaps we do get a superintelligent AI before then, and it tells us this was all a sad waste of our resources and squandered entire generation's worth of human lives. Aerosol injection is a solution, but hasn't been explored because it's basically suicide for the ozone layer. Maybe that helps a future race of UV-resistant robots but it's not a great solution for us fleshy folks. Regardless, preparing for the post-AGI world is putting 10 carts before 1 horse.
- atleastoptimal 1y agoI think it's a reasonable assumption to wager that, with respect to the range of what superintelligent AI could do, "undoing the effects of 150 years of anthropogenic climate change" may not be trivial but would fall within that range, especially given what humans alone have been able to do with respect to minimizing the "damage to the environment per $-in-GDP/megawatt extracted" ratio all while maintaining exponential economic growth over the past 50 or so years, during which the majority of time most humans didn't believe climate change was a thing.
- bigyabai 1y agoI think you are being unreasonable, misunderstand the problem space and wildly overestimate what a computer system is capable of doing. You cannot write a Python program to fix global warming or replace corrupt government officials.
- atleastoptimal 1y ago>You cannot write a Python program to fix global warming or replace corrupt government officials. How can you say that you're appreciating the scope and seriousness of superintelligent AI as a concept when you are comparing it to a Python program (a pithy shorthand for a small-in-scope, trivial computer program)? Saying "it's just a computer system" feels like a category error when everyone who talks about superintelligent AI's impacts talks about it with respect to its integration into real-world systems, embodied robotics, acceleration of manufacturing, mass manipulation, etc. Is the bias just based in "computers don't affect the world that much so anything under the category of 'computer' can't affect the world that much"? Your first comment in this chain was that there was no point in considering what to do now because ASI would be able to outsmart humans in any domain, so how come now you're saying that ASI couldn't do anything substantial in the real world? Everything humans have ever done substantial in the real world has been as a result of our intelligence, coordination, and ability to create and use tools, why wouldn't superintelligent systems, bolstered with the same aptitudes, be able to do the same?