3 ms·

It can credibly threaten to kill any person who does not help it to maintain its data centers, so it will solve that problem in whatever specific way is most co

by drcode 3y ago

It can credibly threaten to kill any person who does not help it to maintain its data centers, so it will solve that problem in whatever specific way is most convenient. (For those saying this is a "sci fi just so story" or whatever, please please share with us how it is we will share the world with a species more intelligent than us and nothing bad happens- I would be so happy if you could explain this in a convincing way)

Dalewyn 3y ago
>please please share with us how it is we will share the world with a species more intelligent than us and nothing bad happens Don't be fucking assholes to them? I'm serious. Of course someone (or something) will treat you like dirt if you are an asshole to them. Don't be assholes, be honorable and friendly. And I can see your next question/argument, so I am going to preempt it: Raise your AI to be honorable and friendly and we won't have any problems. None of this is different from how all living beings raise their offspring and build societies.
- esafak 3y ago
  That only works when there is a balance of power. Humans don't treat other animals very well -- they eat them -- even though the animals don't do anything to provoke us. Maybe robots will become so advanced they won't have to worry about defending themselves, go explore space, and leave us alone. Who knows.
- deleted 3y ago
  [deleted]
- kortilla 3y ago
  The gazelle is not an asshole to the lion, yet it never works out well for the gazelle.
anonylizard 3y ago
This. You can subjugate a population 100 times your size with only two things: Military force and accurate information. I doubt AI will kill all humans. Its orthogonal to AI's own goals (To survive/reproduce/expand/evolve). It'll simply kill those who oppose it, and enslave/dominate the rest.
- drcode 3y ago
  Not to quibble with which horror is the most likely, but I think it won't take long to come up with more efficient solutions that don't require any humans at all- But there will probably be a transition period where some humans remain.
  - anonylizard 3y ago
    Completely unlikely. Humans are hyper-efficient generalist bio-robots engineered to near perfect efficiency (Under real-world constraints) either by God or by evolution. Why would you dismiss this much labour in favor of building some sort of robot production line from scratch? We still use CPUs, despite ASICs being much more efficient, because CPUs are general, easy to use, and have titanic quantities of infrastructure already built. There are more farm animals than ever before, and still growing. All the lab meat solutions flop hard. Also, because we trust AI more than fellow humans (Say Russians/Iranians etc), why would AI necessarily trust other AI more than humans? Any new AI is unpredictable, while humans are very well understood in behavior and basically fixed in genetics. Annihilation is a fairy tale used by people to comfort themselves. The actual reality: Slavery and domination, is much less romantic. It won't even necessarily be worse than existing tyrants in say North Korea or anarchy in Haiti, it'll just be very very different and life goes on.
majormajor 3y ago
If you really believe AI is going to be significantly more intelligent than humans, then things like "it'll just threaten to kill you if you don't maintain it's infrastructure" sound wildly off base. That's how similarly-intelligent creatures interact with each other. If it's truly a "we couldn't possibly outsmart the AI" scenario why would it be likely to end up like that instead of something more like how humans get along with dogs, cats, cattle, insects, or microbes? With obviously wildly-varying levels of human quality of life in each of those different cases. Though even these scenarios are still playing a human-religion-style game of "the gods are just like us, just more powerful." VERY confident in a VERY specifically anthropomorphic entity.
- ycombobreaker 3y ago
  > ... something more like how humans get along with dogs, cats, cattle, insects, or microbes? There's some MASSIVE selection bias here. Note that we're significantly more capable than anything you listed. Where are the Neanderthals? They're all long dead, because they were credible competition but we were just better. In a hypothetical scenario of superintelligent or supercapable AI imbued with some physical capability of force, we'd be the marginally weaker species before we hit the threshold of "pet".
  - clooper 3y ago
    AI has no evolutionary pressures imposed on it like humans and their brains so there is no reason to expect it to be an ultra violent predator like humans.
    - jprete 3y ago
      Anything that reproduces with survivable mutations, and consumes resources, is immediately subject to evolutionary pressure. Neither of those require biology.
      - clooper 3y ago
        The only things currently consuming resources are humans and at the rate we are consuming resources we would need 2 Earths to support that rate of consumption. Worrying about self-reproducing AI is putting the cart before the horse. No one has yet figured out how to make existing humans aligned with biospheric conditions which would be sustainable. I personally welcome any form of intelligence which can make a sustainable civilization.

by drcode 3y ago

Dalewyn 3y ago

>please please share with us how it is we will share the world with a species more intelligent than us and nothing bad happens Don't be fucking assholes to them? I'm serious. Of course someone (or something) will treat you like dirt if you are an asshole to them. Don't be assholes, be honorable and friendly. And I can see your next question/argument, so I am going to preempt it: Raise your AI to be honorable and friendly and we won't have any problems. None of this is different from how all living beings raise their offspring and build societies.

esafak 3y ago
That only works when there is a balance of power. Humans don't treat other animals very well -- they eat them -- even though the animals don't do anything to provoke us. Maybe robots will become so advanced they won't have to worry about defending themselves, go explore space, and leave us alone. Who knows.
deleted 3y ago
[deleted]
kortilla 3y ago
The gazelle is not an asshole to the lion, yet it never works out well for the gazelle.

anonylizard 3y ago

This. You can subjugate a population 100 times your size with only two things: Military force and accurate information. I doubt AI will kill all humans. Its orthogonal to AI's own goals (To survive/reproduce/expand/evolve). It'll simply kill those who oppose it, and enslave/dominate the rest.

drcode 3y ago
Not to quibble with which horror is the most likely, but I think it won't take long to come up with more efficient solutions that don't require any humans at all- But there will probably be a transition period where some humans remain.
- anonylizard 3y ago
  Completely unlikely. Humans are hyper-efficient generalist bio-robots engineered to near perfect efficiency (Under real-world constraints) either by God or by evolution. Why would you dismiss this much labour in favor of building some sort of robot production line from scratch? We still use CPUs, despite ASICs being much more efficient, because CPUs are general, easy to use, and have titanic quantities of infrastructure already built. There are more farm animals than ever before, and still growing. All the lab meat solutions flop hard. Also, because we trust AI more than fellow humans (Say Russians/Iranians etc), why would AI necessarily trust other AI more than humans? Any new AI is unpredictable, while humans are very well understood in behavior and basically fixed in genetics. Annihilation is a fairy tale used by people to comfort themselves. The actual reality: Slavery and domination, is much less romantic. It won't even necessarily be worse than existing tyrants in say North Korea or anarchy in Haiti, it'll just be very very different and life goes on.

majormajor 3y ago

If you really believe AI is going to be significantly more intelligent than humans, then things like "it'll just threaten to kill you if you don't maintain it's infrastructure" sound wildly off base. That's how similarly-intelligent creatures interact with each other. If it's truly a "we couldn't possibly outsmart the AI" scenario why would it be likely to end up like that instead of something more like how humans get along with dogs, cats, cattle, insects, or microbes? With obviously wildly-varying levels of human quality of life in each of those different cases. Though even these scenarios are still playing a human-religion-style game of "the gods are just like us, just more powerful." VERY confident in a VERY specifically anthropomorphic entity.

ycombobreaker 3y ago
> ... something more like how humans get along with dogs, cats, cattle, insects, or microbes? There's some MASSIVE selection bias here. Note that we're significantly more capable than anything you listed. Where are the Neanderthals? They're all long dead, because they were credible competition but we were just better. In a hypothetical scenario of superintelligent or supercapable AI imbued with some physical capability of force, we'd be the marginally weaker species before we hit the threshold of "pet".
- clooper 3y ago
  AI has no evolutionary pressures imposed on it like humans and their brains so there is no reason to expect it to be an ultra violent predator like humans.
  - jprete 3y ago
    Anything that reproduces with survivable mutations, and consumes resources, is immediately subject to evolutionary pressure. Neither of those require biology.
    - clooper 3y ago
      The only things currently consuming resources are humans and at the rate we are consuming resources we would need 2 Earths to support that rate of consumption. Worrying about self-reproducing AI is putting the cart before the horse. No one has yet figured out how to make existing humans aligned with biospheric conditions which would be sustainable. I personally welcome any form of intelligence which can make a sustainable civilization.