3 ms·

In that scenario, you are the one claiming we will "never" fly to jupiter.

timr 3y ago
Just to close the metaphorical loop here, the current AI debate is something like: "There's a danger we'll be able to fly to Jupiter and bring home a Jupiterian life-form that will destroy humanity. Therefore we should stop all space exploration." The doomers take the equation with some wildly improbable step that we can't currently explain or justify, multiply the outcome of that step by "infinitely bad", and conclude that the whole thing must be dangerous. But to amp up the rhetoric, they always skip over the "wildly improbable" part.
- adroniser 3y ago
  I guess the disagreement you have with doomers is the probablility you assign to us being able to create human level AI. For the record most "doomers" don't pull a pascal's wager here. Standard EA doctrine is that if we stagnate technologically at our current level for too long (read centuries) then we will inevitably be wiped out. So they want technological advance, they just want caution.
  - timr 3y ago
    I don't know what "most" do, but I see that form of argument all the time -- particularly from the highest profile doomers. Personally, I think this line of argument is driven by the hype cycle more than reality. Use chatGPT or midjourney or whatever for a while, and it's pretty easy to see that we're dramatically overweighting theories of AGI risk, and dramatically underweighting stuff like "disemploying the bottom 80% of the intelligence bell curve" with technologies that automate away lots of formerly white-collar labor. If I had to put my money on an "existential risk" attributable to AI, it would be economic strife.
    - adroniser 3y ago
      It's worth saying we still haven't seen a single model trained post-hype cycle from openAI. GPT-4 was summer 2022 stuff.
dullcrisp 3y ago
I’m saying that there are very many things that I can’t prove are impossible that I don’t worry about happening. I’ve learned to live with that uncertainty.

timr 3y ago

Just to close the metaphorical loop here, the current AI debate is something like: "There's a danger we'll be able to fly to Jupiter and bring home a Jupiterian life-form that will destroy humanity. Therefore we should stop all space exploration." The doomers take the equation with some wildly improbable step that we can't currently explain or justify, multiply the outcome of that step by "infinitely bad", and conclude that the whole thing must be dangerous. But to amp up the rhetoric, they always skip over the "wildly improbable" part.

adroniser 3y ago
I guess the disagreement you have with doomers is the probablility you assign to us being able to create human level AI. For the record most "doomers" don't pull a pascal's wager here. Standard EA doctrine is that if we stagnate technologically at our current level for too long (read centuries) then we will inevitably be wiped out. So they want technological advance, they just want caution.
- timr 3y ago
  I don't know what "most" do, but I see that form of argument all the time -- particularly from the highest profile doomers. Personally, I think this line of argument is driven by the hype cycle more than reality. Use chatGPT or midjourney or whatever for a while, and it's pretty easy to see that we're dramatically overweighting theories of AGI risk, and dramatically underweighting stuff like "disemploying the bottom 80% of the intelligence bell curve" with technologies that automate away lots of formerly white-collar labor. If I had to put my money on an "existential risk" attributable to AI, it would be economic strife.
  - adroniser 3y ago
    It's worth saying we still haven't seen a single model trained post-hype cycle from openAI. GPT-4 was summer 2022 stuff.

dullcrisp 3y ago

I’m saying that there are very many things that I can’t prove are impossible that I don’t worry about happening. I’ve learned to live with that uncertainty.