3 ms·

An alien is not the same thing as a computer program which can be easily terminated.

ACCount37 1y ago
OpenAI couldn't even "terminate" GPT-4o, and that thing certainly wasn't superintelligent. Don't expect an ASI to go down as easily as 4o did.
reducesuffering 1y ago
A 300 IQ alien will have outmaneuvered you so well, it wouldn't even let you get to a point where you think you might have to turn it off.
pixl97 1y ago
Think for at least 5 seconds before typing. Humanity already is integrating these into systems where they cannot be easily terminated. Think infrastructure and military systems. And in this case we're talking about a system that's smarter than you. It will become part of vital systems like electricity and distribution where when deciding to shut it off you are making a trade off of how much your economy and the people in it you're going to kill. And that's not even taking future miniaturization where we could end up with ASI on small/portable devices.
AlexandrB 1y ago
It's worse than that for AI. Like crypto before it, it depends on an entire planet of complex and vulnerable infrastructure that makes it possible. Everything from semiconductor manufacturing to power generation to intercontinental internet links are required for AI to "exist" in a given geography. That's not to mention the huge power requirements and all the infrastructure just to get that. Dark ages style societal collapse or a world war would end AI in a matter of months.
- pixl97 1y ago
  >Dark ages style societal collapse or a world war would end AI in a matter of months. I mean, in that case 9/10ths of humanity is likely dead too. The 20th century broke the rather anti-fragile setup that humanity had and setup a situation where our daily living requires working transportation networks for almost everything.
- array_key_first 1y ago
  Unless the AI is so smart it invents super robots that can create all that stuff much faster than people. Ahhh, unagi.

OpenAI couldn't even "terminate" GPT-4o, and that thing certainly wasn't superintelligent. Don't expect an ASI to go down as easily as 4o did.

reducesuffering 1y ago

A 300 IQ alien will have outmaneuvered you so well, it wouldn't even let you get to a point where you think you might have to turn it off.

pixl97 1y ago

Think for at least 5 seconds before typing. Humanity already is integrating these into systems where they cannot be easily terminated. Think infrastructure and military systems. And in this case we're talking about a system that's smarter than you. It will become part of vital systems like electricity and distribution where when deciding to shut it off you are making a trade off of how much your economy and the people in it you're going to kill. And that's not even taking future miniaturization where we could end up with ASI on small/portable devices.

AlexandrB 1y ago

It's worse than that for AI. Like crypto before it, it depends on an entire planet of complex and vulnerable infrastructure that makes it possible. Everything from semiconductor manufacturing to power generation to intercontinental internet links are required for AI to "exist" in a given geography. That's not to mention the huge power requirements and all the infrastructure just to get that. Dark ages style societal collapse or a world war would end AI in a matter of months.

pixl97 1y ago
>Dark ages style societal collapse or a world war would end AI in a matter of months. I mean, in that case 9/10ths of humanity is likely dead too. The 20th century broke the rather anti-fragile setup that humanity had and setup a situation where our daily living requires working transportation networks for almost everything.
array_key_first 1y ago
Unless the AI is so smart it invents super robots that can create all that stuff much faster than people. Ahhh, unagi.