3 ms·

"An AI programmed to solve a difficult optimization problem might convert the entire mass of the solar system into a giant computer." ha :) i love this. my ini

"An AI programmed to solve a difficult optimization problem might convert the entire mass of the solar system into a giant computer." ha :) i love this. my initial reaction was again- this is a huge assumption. that is, you're assuming self-preservation would be a goal, before sustaining human life. but then i realized, i guess this is your point! regardless of what goals we intend to program for, their solutions are unknown to us and could be catastrophic by our definitions. that all said; i welcome robot catastrophe too. if it's going to happen it's going to happen and i'd prefer it be while i can experience it.

marvin 13y ago
>if it's going to happen it's going to happen and i'd prefer it be while i can experience it. It'd certainly be fascinating. But I think I would rather that humanity does whatever it can do ensure that any artificial intelligence we create won't cause an outcome that is bad for humanity.
Houshalter 13y ago
>i welcome robot catastrophe too. if it's going to happen it's going to happen and i'd prefer it be while i can experience it. I'd rather it turn out friendly than unfriendly, and I'd rather have as much time as possible to either figure it out or live out my life. There'd be nothing to experience anyways. The AI might kill us all overnight with super-lethal virus, nukes, or swarms of nanobots.