3 ms·

I genuinely can't understand the doom. Can someone provide me with a realistic step by step scenario where language models destroy human civilization? How can i

I genuinely can't understand the doom. Can someone provide me with a realistic step by step scenario where language models destroy human civilization? How can it counter each individual step we take to correct/secure our computer systems? I feel like I'm lost here. There is beautiful mental gymnastics we have to make to conclude that AI will cause the civilization destroying dangers that we all think(want?) to happen. The only thing that I can think of is somehow a language model accidentally launches all the nukes in the world. But, that assumes that literally every step of the process can be actioned upon by typing text into a terminal. There's many armed people and physical keys that are in between GPT4 and the launch codes...

p1esk 3y ago
Two likely scenarios: 1. Bad people will use powerful models to do bad things. 2. Many jobs will be automated, and many people will get laid off.
- animal_spirits 3y ago
  1. Bad people people have been doing bad things literally each and every day since the dawn of man. How does ChatGPT make this different? Do good guys not get the same tools to make the world better and safer? 2. This scenario I can understand causing _upheaval_ and significant societal change, but I can't see it causing the death of the human project like some predict. Will there be more food in this new society where it's incredibly cheap and efficient to make it? I presume so. Is it impossible for us to figure out how to distribute the food? No. Why will humanity come to it's end because people are not required to crunch numbers in excel day after day anymore? I'm not trying to be an ass, I just haven't seen an explanation that makes actual realistic conclusions.
  - p1esk 3y ago
    I thought we were talking about why would someone be concerned with recent progress in AI. That’s the question I tried to answer.
- CommanderData 3y ago
  2. Regulate. Restrictions on companies using AI to soften the blow - I don't think we're ready as a society to adapt to fast changes and potential mass removal of certain job families. 1. Don't restrict this. Open source will develop AI further etc. Perhaps a knee jerk reaction at how one can use this tech in military applications. Regulation to stop selfish profits, companies are lusting over themselves to make people's livelihood obsolete. Capitalism and AI might be a toxic mix in the end.
  - p1esk 3y ago
    How can you possibly regulate 2?

p1esk 3y ago

Two likely scenarios: 1. Bad people will use powerful models to do bad things. 2. Many jobs will be automated, and many people will get laid off.

animal_spirits 3y ago
1. Bad people people have been doing bad things literally each and every day since the dawn of man. How does ChatGPT make this different? Do good guys not get the same tools to make the world better and safer? 2. This scenario I can understand causing _upheaval_ and significant societal change, but I can't see it causing the death of the human project like some predict. Will there be more food in this new society where it's incredibly cheap and efficient to make it? I presume so. Is it impossible for us to figure out how to distribute the food? No. Why will humanity come to it's end because people are not required to crunch numbers in excel day after day anymore? I'm not trying to be an ass, I just haven't seen an explanation that makes actual realistic conclusions.
- p1esk 3y ago
  I thought we were talking about why would someone be concerned with recent progress in AI. That’s the question I tried to answer.
CommanderData 3y ago
2. Regulate. Restrictions on companies using AI to soften the blow - I don't think we're ready as a society to adapt to fast changes and potential mass removal of certain job families. 1. Don't restrict this. Open source will develop AI further etc. Perhaps a knee jerk reaction at how one can use this tech in military applications. Regulation to stop selfish profits, companies are lusting over themselves to make people's livelihood obsolete. Capitalism and AI might be a toxic mix in the end.
- p1esk 3y ago
  How can you possibly regulate 2?