4 ms·

I'd think that that friendly super intelligence would realize the issues associated with post-scarcity society and would act in the best interests of humanity.

by lione 12y ago

I'd think that that friendly super intelligence would realize the issues associated with post-scarcity society and would act in the best interests of humanity. It would weight human happiness as more important and work to avoid the pitfalls that would be undesirable. There's more utility for it in the human population being happy/not giving up on life then most of the things it would do (assuming it's primary goal is to further and safeguard the human race). There would be aspects of society it COULD run, but feel that giving us purpose would be more beneficial then the increase in productivity or whatever of it running that aspect of society. Maybe it can make beautiful gardens and art, but instead leaves it to the humans to give them some sort of purpose. I don't see how or why a post-scarcity society would do away with art/culture/many of the subjective things that make life worth living and provide purpose. Most people don't quit doing the things they like just because someone is better at it. My two cents.

rl3 12y ago
I think you may be right. Admittedly, most of what I said was really only applicable to a Genie superintelligence that implements our wishes on a command-by-command basis. A friendly Sovereign superintelligence (i.e. operating under its own goal/value-directed volition) would probably not rob us of purpose, though the societal changes in either scenario would likely still be quite profound. Of course, a positive superintelligence outcome would be a miracle in and of itself, so there's that. Coming to terms with a newly created utopian society sure beats extinction.
- lione 12y ago
  Even a friendly Genie superintelligence would likely not cause that IMO. It would work to remove the problems we set before it. Unless we asked it to remove culture and fun/worthwhile hobbys/activities, I don't see how it would cause issues or ennui. We would still have purpose, it would just not be focused on or influenced by those solved issues. And even if those problems are solved within our society on Earth, who knows what the future holds in terms of the wide open universe.

by lione 12y ago

rl3 12y ago

I think you may be right. Admittedly, most of what I said was really only applicable to a Genie superintelligence that implements our wishes on a command-by-command basis. A friendly Sovereign superintelligence (i.e. operating under its own goal/value-directed volition) would probably not rob us of purpose, though the societal changes in either scenario would likely still be quite profound. Of course, a positive superintelligence outcome would be a miracle in and of itself, so there's that. Coming to terms with a newly created utopian society sure beats extinction.

lione 12y ago
Even a friendly Genie superintelligence would likely not cause that IMO. It would work to remove the problems we set before it. Unless we asked it to remove culture and fun/worthwhile hobbys/activities, I don't see how it would cause issues or ennui. We would still have purpose, it would just not be focused on or influenced by those solved issues. And even if those problems are solved within our society on Earth, who knows what the future holds in terms of the wide open universe.