4 ms·

Artificial intelligence warning over human extinction labelled “publicity stunt”

20 points by ojosilva 3y ago

f_devd 3y ago
I don't disagree that most of the warnings perpetuated are probably part of a publicity stunt (or hype men). However there is a fair chance we will reach super-human autonomous actors in the next 50-100 years, and if we fail to align them very closely to human values it would be an extreme risk to all life. The point is that currently there is effectively zero effort put into (AI Safety research) an existential risk we can actually see coming. It may not happen at all (we could stop progressing compute efficiency/density before then) but trajectories suggest it will eventually. For a more nuanced discussion of the actual risks I recommend watching/listening to the ML Street Talk w/ Robert Miles: https://www.youtube.com/watch?v=kMLKbhY0ji0 https://www.youtube.com/watch?v=kMLKbhY0ji0
jimrandomh 3y ago
There is a difference between disagreeing with predictions about the future, and accusing the people making those predictions of lying about their own beliefs. This article does the latter. And, ngl, it's been pretty wild watching the AI risk-skeptical narrative pivot from claiming that AI risk is a fringe issue which no experts think is plausible, to claiming that a large fraction of the relevant experts are lying about their beliefs. No, they're not lying. The people who signed the letter did so because they believe what it says.
- RecycledEle 3y ago
  I believe the main desire of the people warning about AI is to protect their positions, whether those positions are creative positions, or whether those positions are building AIs. They do not want competition. If the wheel were invented today, sled makers would lobby to get it banned, and they would win.
  - space_fountain 3y ago
    Why do you say that? What incentive does say the rationalist community have? They’ve been on this subject for along while?
Randomizer42 3y ago
It is a publicity stunt
precompute 3y ago
100%, "Open""AI" is 30% product 70% marketing.
BizarroLand 3y ago
This reads like blurb text you would read on Plague, Inc. when you're midway through destroying humanity.

20 points by ojosilva 3y ago

I don't disagree that most of the warnings perpetuated are probably part of a publicity stunt (or hype men). However there is a fair chance we will reach super-human autonomous actors in the next 50-100 years, and if we fail to align them very closely to human values it would be an extreme risk to all life. The point is that currently there is effectively zero effort put into (AI Safety research) an existential risk we can actually see coming. It may not happen at all (we could stop progressing compute efficiency/density before then) but trajectories suggest it will eventually. For a more nuanced discussion of the actual risks I recommend watching/listening to the ML Street Talk w/ Robert Miles: https://www.youtube.com/watch?v=kMLKbhY0ji0 https://www.youtube.com/watch?v=kMLKbhY0ji0

jimrandomh 3y ago

There is a difference between disagreeing with predictions about the future, and accusing the people making those predictions of lying about their own beliefs. This article does the latter. And, ngl, it's been pretty wild watching the AI risk-skeptical narrative pivot from claiming that AI risk is a fringe issue which no experts think is plausible, to claiming that a large fraction of the relevant experts are lying about their beliefs. No, they're not lying. The people who signed the letter did so because they believe what it says.

RecycledEle 3y ago
I believe the main desire of the people warning about AI is to protect their positions, whether those positions are creative positions, or whether those positions are building AIs. They do not want competition. If the wheel were invented today, sled makers would lobby to get it banned, and they would win.
- space_fountain 3y ago
  Why do you say that? What incentive does say the rationalist community have? They’ve been on this subject for along while?

Randomizer42 3y ago

It is a publicity stunt

precompute 3y ago

100%, "Open""AI" is 30% product 70% marketing.

BizarroLand 3y ago

This reads like blurb text you would read on Plague, Inc. when you're midway through destroying humanity.