3 ms·

> Strong AI is most likely to bring 2 outcomes: salvation (if we're very careful), or doom (the default outcome). Funny thing is, it's not like AI is going to

> Strong AI is most likely to bring 2 outcomes: salvation (if we're very careful), or doom (the default outcome). Funny thing is, it's not like AI is going to make a landing here from outer space. It's not some external factor that we don't control. It's us who are building it. Any possible outcome could be avoided if we just stop working on it. I know this is not going to happen, but I feel this is the kind of obvious thing that ought to be stated once in a while.

dota_fanatic 10y ago
> Any possible outcome could be avoided if we just stop working on it. Except we live in a world where selfish persons will and do use any advantage to get ahead, with little care for side effects so long as they get ahead. For every funded attempt at creating and controlling stronger ai that gets shut down because it's deemed unwieldy, others will not be so cautious. The cat will get out of the bag if we're ever able to create one. Question: do you feel like anyone controls the behavior of any given international company? Or does the company control the people? These lines aren't so clear imho, just as it won't be clear as we give more and more power to intelligent computer systems.
- TeMPOraL 10y ago
  That is dangerous enough before you even consider that governments are interested in this technology too; particularly DARPA has a history of throwing a lot of money at this problem. Even if suddenly the market decided it doesn't care about AI anymore, you still have countries competing with each other over military dominance.
TeMPOraL 10y ago
> It's not some external factor that we don't control. It's us who are building it. There's also another kind of obvious thing that ought to be stated every once in a while: that at this scale, we don't control shit. There is no one on this planet who could ban AI research. Not one person, not one organization. What humanity as a whole is working on is determined mostly by factors like economic incentives and existing technology landscape - both of them now push us towards building more and more intelligent software. To stop that, you'd have to nuke the whole planet back to stone age.
- hipjiveguy 10y ago
  rarely do i laugh out loud reading the web, but you got me ;-) very very true!

dota_fanatic 10y ago

> Any possible outcome could be avoided if we just stop working on it. Except we live in a world where selfish persons will and do use any advantage to get ahead, with little care for side effects so long as they get ahead. For every funded attempt at creating and controlling stronger ai that gets shut down because it's deemed unwieldy, others will not be so cautious. The cat will get out of the bag if we're ever able to create one. Question: do you feel like anyone controls the behavior of any given international company? Or does the company control the people? These lines aren't so clear imho, just as it won't be clear as we give more and more power to intelligent computer systems.

TeMPOraL 10y ago
That is dangerous enough before you even consider that governments are interested in this technology too; particularly DARPA has a history of throwing a lot of money at this problem. Even if suddenly the market decided it doesn't care about AI anymore, you still have countries competing with each other over military dominance.

TeMPOraL 10y ago

> It's not some external factor that we don't control. It's us who are building it. There's also another kind of obvious thing that ought to be stated every once in a while: that at this scale, we don't control shit. There is no one on this planet who could ban AI research. Not one person, not one organization. What humanity as a whole is working on is determined mostly by factors like economic incentives and existing technology landscape - both of them now push us towards building more and more intelligent software. To stop that, you'd have to nuke the whole planet back to stone age.

hipjiveguy 10y ago
rarely do i laugh out loud reading the web, but you got me ;-) very very true!