3 ms·

To add to your counterpoints: 6. While it is about sure that in the future they will be technology that is for indistinguishable from magic, this does not impl

To add to your counterpoints: 6. While it is about sure that in the future they will be technology that is for indistinguishable from magic, this does not imply that every magical thing we can think of will be true at some point in the future. 7. The whole premise rests on recursively improving AI. The human race has been making tool to help make them better tools for at least 50,000 years (lower bound to be uncontroversial). We do have amazing tools now, and tools that automatically do other tools, but we have not witnessed an accelerated auto-recursive thingamagig.

TheCraiggers 13y ago
>We do have amazing tools now, and tools that automatically do other tools, but we have not witnessed an accelerated auto-recursive thingamagig. I've never seen liverwurst icecream. I don't have to taste it to know with 99% certainty that it's a bad idea. On a more serious note, I've never strapped 500 roman candles on my back and lit them all at once in an attempt at making a "jetpack". Again, I don't need to perform the experiment to know I would likely receive burns and possibly die. The remarkable thing about our brains is that we have the ability to predict what will happen in our heads, empathize with the actor in that scenario, and then come to a conclusion about if we want that scenario to play out. So, to apply this to your counterpoint, I don't have to see an accelerated auto-recursive thingamajig to know it is likely going to be impossible to control and a bad idea.