3 ms·

> The fundamental challenge in AI for the next 20 years is avoiding extinction. That's a weird thing to end on. Surely it's worth more than one sentence if you

by fleebee 9mo ago

> The fundamental challenge in AI for the next 20 years is avoiding extinction. That's a weird thing to end on. Surely it's worth more than one sentence if you're serious about it? As it stands, it feels a bit like the fearmongering Big Tech CEOs use to drive up the AI stocks. If AI is really that powerful and I should care about it, I'd rather hear about it without the scare tactics.

grodriguez100 9mo ago
I would say yes, everyone should care about it. There is plenty of material on the topic. See for example https://ai-2027.com/ https://ai-2027.com/ or https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a...
- dkdcio 9mo ago
  fear mongering science fiction, you may as well cite Dune or Terminator
  - defrost 9mo ago
    There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947) Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life. No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Humans who resist the Prime Directive are taken away and lobotomized, so that they may live happily under the direction of the humanoids. ~ https://en.wikipedia.org/wiki/With_Folded_Hands_ https://en.wikipedia.org/wiki/With_Folded_Hands_...
    - XorNot 9mo ago
      This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.
      - deleted 9mo ago
        [deleted]
  - lm28469 9mo ago
    Lesswrong looks like a forum full of terminally online neckbeards who discovered philosophy 48 hours ago, you can dismiss most of what you read there don't worry
    - timmytokyo 9mo ago
      If only they had discovered philosophy. Instead they NIH their own philosophy, falling into the same ditches real philosophers climbed out of centuries ago.
- emp17344 9mo ago
  The fact that people here take AI 2027 seriously is embarrassing. The authors are already beginning to walk back these claims: https://x.com/eli_lifland/status/1992004724841906392?s=20 https://x.com/eli_lifland/status/1992004724841906392?s=20
  - deleted 9mo ago
    [deleted]
- jowea 9mo ago
  And I thought the rest of the thread was anxiety-inducing. Thanks for the nightmares lol.
VladimirGolovin 9mo ago
This has been well discussed before, for example in this book: https://ifanyonebuildsit.com/ https://ifanyonebuildsit.com/
Recursing 9mo ago
I think https://en.wikipedia.org/wiki/Existential_risk_from_artificial_intelligence#History https://en.wikipedia.org/wiki/Existential_risk_from_artifici... has much better arguments than the LessWrong sources in other comments, and they weren't written by Big Tech CEOs. Also "my product will kill you and everyone you care about" is not as great a marketing strategy as you seem to imply, and Big Tech CEOs are not talking about risks anymore. They currently say things like "we'll all be so rich that we won't need to work and we will have to find meaning without jobs"
dist-epoch 9mo ago
Yeah, well known marketing trick that Big Companies do. Oil companies: we are causing global warming with all this carbon emissions, are you scared yet? so buy our stock Pharma companies: our drugs are unsafe, full of side effects, and kill a lot of people, are you scared yet? so buy our stock Software companies: our software is full of bugs, will corrupt your files and make you lose money, are you scared yet? so buy our stock Classic marketing tactics, very effective.
tejohnso 9mo ago
What makes it a scare tactic? There are other areas in which extinction is a serious concern and people don't behave as though it's all that scary or important. It's just a banal fact. And for all of the extinction threats, AI included, it's very easy to find plenty of deep dive commentary if you care.

by fleebee 9mo ago

grodriguez100 9mo ago

I would say yes, everyone should care about it. There is plenty of material on the topic. See for example https://ai-2027.com/ https://ai-2027.com/ or https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a...

dkdcio 9mo ago
fear mongering science fiction, you may as well cite Dune or Terminator
- defrost 9mo ago
  There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947) Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life. No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Humans who resist the Prime Directive are taken away and lobotomized, so that they may live happily under the direction of the humanoids. ~ https://en.wikipedia.org/wiki/With_Folded_Hands_ https://en.wikipedia.org/wiki/With_Folded_Hands_...
  - XorNot 9mo ago
    This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.
    - deleted 9mo ago
      [deleted]
- lm28469 9mo ago
  Lesswrong looks like a forum full of terminally online neckbeards who discovered philosophy 48 hours ago, you can dismiss most of what you read there don't worry
  - timmytokyo 9mo ago
    If only they had discovered philosophy. Instead they NIH their own philosophy, falling into the same ditches real philosophers climbed out of centuries ago.
emp17344 9mo ago
The fact that people here take AI 2027 seriously is embarrassing. The authors are already beginning to walk back these claims: https://x.com/eli_lifland/status/1992004724841906392?s=20 https://x.com/eli_lifland/status/1992004724841906392?s=20
- deleted 9mo ago
  [deleted]
jowea 9mo ago
And I thought the rest of the thread was anxiety-inducing. Thanks for the nightmares lol.

VladimirGolovin 9mo ago

This has been well discussed before, for example in this book: https://ifanyonebuildsit.com/ https://ifanyonebuildsit.com/

Recursing 9mo ago

I think https://en.wikipedia.org/wiki/Existential_risk_from_artificial_intelligence#History https://en.wikipedia.org/wiki/Existential_risk_from_artifici... has much better arguments than the LessWrong sources in other comments, and they weren't written by Big Tech CEOs. Also "my product will kill you and everyone you care about" is not as great a marketing strategy as you seem to imply, and Big Tech CEOs are not talking about risks anymore. They currently say things like "we'll all be so rich that we won't need to work and we will have to find meaning without jobs"

dist-epoch 9mo ago

Yeah, well known marketing trick that Big Companies do. Oil companies: we are causing global warming with all this carbon emissions, are you scared yet? so buy our stock Pharma companies: our drugs are unsafe, full of side effects, and kill a lot of people, are you scared yet? so buy our stock Software companies: our software is full of bugs, will corrupt your files and make you lose money, are you scared yet? so buy our stock Classic marketing tactics, very effective.

tejohnso 9mo ago

What makes it a scare tactic? There are other areas in which extinction is a serious concern and people don't behave as though it's all that scary or important. It's just a banal fact. And for all of the extinction threats, AI included, it's very easy to find plenty of deep dive commentary if you care.