5 ms·

>Turning on an AI or copying the code for one and spreading it would probably be easiear. What people never mention in any discussion with AI is that the AI wi

by 6d6b73 9y ago

>Turning on an AI or copying the code for one and spreading it would probably be easiear. What people never mention in any discussion with AI is that the AI will be as limited by physical world as we are. AI It's not just code, it's also the hardware that will run the code. That hardware has theoretical and practical limits, and requires a lot of power. It's not like AI running on some peta/exascale supercomputer will be able to jump to your laptop and take it over and spread itself to every electronic device in the world.

mindcrime 9y ago
Exactly. And that's one big reason I find so many of these "doomsday" scenarios less than useful. They're largely based on a view of AI that's rooted in science-fiction, not reality.
AndrewKemendo 9y ago
It's not like AI running on some peta/exascale supercomputer will be able to jump to your laptop and take it over and spread itself to every electronic device in the world That's exactly a proposed scenario - with the form of "jumping" being any kind of communication. See: The AI Box problem. https://en.wikipedia.org/wiki/AI_box https://en.wikipedia.org/wiki/AI_box
- 6d6b73 9y ago
  If the AI requires a supercomputer to "exists" it can only jump to another supercomputer. It will not be able to spread to your Arduino.
  - AndrewKemendo 9y ago
    Or it could figure out how to distribute it's computing and then distribute itself a piece at a time off of the "supercomputer."
    - 6d6b73 9y ago
      Or maybe it could decide to move to another universe and take it over.. There are physical limitations to what AI even in the form of super-intelligence can do. While theoretically it could distribute itself to other computers, it first would need to learn a lot everything from math to computer security, which itself would take implies that it would have unlimited resources and time to do all of that.. Even if that superAI did learn all of the skills necessary to take over many computers (it would need to learn about architectures, operating systems, firewalls, antivirus, compilers etc) it would still be limited by the latency of the network so not all operations would make sense in a distributed system. And of course it would need to be so smart that nobody would notice that there is increase of "weird" traffic on the internet, that suddenly power usage would increase as computers would do all these calculations instead of sitting idle waiting for user to open fb.com. To take over the world such AI would need to learn everything we already know about the world, not only including math and physics, but also including sociology and human behavior. While AI would be busy taking over the world, you would have to assume that we would be sitting, doing nothing, and that we would not be smart enough to figure out that something is going on. And when we did we would do nothing to stop it. Is it possible, sure.. Likely? hell no.
fossuser 9y ago
I think the main argument against this is once you're in the world of "super intelligence" you're severely outmatched. If for some reason it had an interest in staying on it might not be easy to stop.
- 6d6b73 9y ago
  super intelligence will not happen overnight. AI will keep evolving with us and before it's truly conscious it will give us better understanding of math, physics, medicine.. This will help the AI grow, but at the same time we will be growing with it. It will be a symbiotic relationship.
  - fossuser 9y ago
    Not necessarily, there's the idea of an "intelligence explosion" - basically that while it may take a while to figure out the initial conditions it might be able to self improve rapidly from that point. Also consciousness may not be required (or possibly even preferable).
    - 6d6b73 9y ago
      "intelligence explosion" is also limited by the physical world. AI won't be able to come up with a better understanding of physics simply by reading academic journals. Yes it might have some good ideas, and find some of the stuff we're missing by simply connecting the dots, but that in no way will cause "intelligence explosion". Just think how much money and time we have to spend to test just a few of all of the theories in physics. And no, AI will not be able to suddenly come up with better theories simply by simulating physical world.
    - TheGrassyKnoll 9y ago
      "Colossus: The Forbin Project" (1970) http://www.imdb.com/title/tt0064177/?ref_=fn_al_tt_1 http://www.imdb.com/title/tt0064177/?ref_=fn_al_tt_1

by 6d6b73 9y ago

mindcrime 9y ago

Exactly. And that's one big reason I find so many of these "doomsday" scenarios less than useful. They're largely based on a view of AI that's rooted in science-fiction, not reality.

AndrewKemendo 9y ago

It's not like AI running on some peta/exascale supercomputer will be able to jump to your laptop and take it over and spread itself to every electronic device in the world That's exactly a proposed scenario - with the form of "jumping" being any kind of communication. See: The AI Box problem. https://en.wikipedia.org/wiki/AI_box https://en.wikipedia.org/wiki/AI_box

6d6b73 9y ago
If the AI requires a supercomputer to "exists" it can only jump to another supercomputer. It will not be able to spread to your Arduino.
- AndrewKemendo 9y ago
  Or it could figure out how to distribute it's computing and then distribute itself a piece at a time off of the "supercomputer."
  - 6d6b73 9y ago
    Or maybe it could decide to move to another universe and take it over.. There are physical limitations to what AI even in the form of super-intelligence can do. While theoretically it could distribute itself to other computers, it first would need to learn a lot everything from math to computer security, which itself would take implies that it would have unlimited resources and time to do all of that.. Even if that superAI did learn all of the skills necessary to take over many computers (it would need to learn about architectures, operating systems, firewalls, antivirus, compilers etc) it would still be limited by the latency of the network so not all operations would make sense in a distributed system. And of course it would need to be so smart that nobody would notice that there is increase of "weird" traffic on the internet, that suddenly power usage would increase as computers would do all these calculations instead of sitting idle waiting for user to open fb.com. To take over the world such AI would need to learn everything we already know about the world, not only including math and physics, but also including sociology and human behavior. While AI would be busy taking over the world, you would have to assume that we would be sitting, doing nothing, and that we would not be smart enough to figure out that something is going on. And when we did we would do nothing to stop it. Is it possible, sure.. Likely? hell no.

fossuser 9y ago

I think the main argument against this is once you're in the world of "super intelligence" you're severely outmatched. If for some reason it had an interest in staying on it might not be easy to stop.

6d6b73 9y ago
super intelligence will not happen overnight. AI will keep evolving with us and before it's truly conscious it will give us better understanding of math, physics, medicine.. This will help the AI grow, but at the same time we will be growing with it. It will be a symbiotic relationship.
- fossuser 9y ago
  Not necessarily, there's the idea of an "intelligence explosion" - basically that while it may take a while to figure out the initial conditions it might be able to self improve rapidly from that point. Also consciousness may not be required (or possibly even preferable).
  - 6d6b73 9y ago
    "intelligence explosion" is also limited by the physical world. AI won't be able to come up with a better understanding of physics simply by reading academic journals. Yes it might have some good ideas, and find some of the stuff we're missing by simply connecting the dots, but that in no way will cause "intelligence explosion". Just think how much money and time we have to spend to test just a few of all of the theories in physics. And no, AI will not be able to suddenly come up with better theories simply by simulating physical world.
  - TheGrassyKnoll 9y ago
    "Colossus: The Forbin Project" (1970) http://www.imdb.com/title/tt0064177/?ref_=fn_al_tt_1 http://www.imdb.com/title/tt0064177/?ref_=fn_al_tt_1