3 ms·
It matters, and here's why: natural intelligences, reasonably defined as intelligence evolved through natural selection, can be expected to have some convergent
by kobeya 10y ago
It matters, and here's why: natural intelligences, reasonably defined as intelligence evolved through natural selection, can be expected to have some convergent properties. The convergent instrumental goals of resource acquisition and self-preservation naturally arise, of course, but the same is probably said of artificial entities too. Naturally evolved intelligences on the other hand are very likely to have moralities of a recognizable (even if foreign) sort -- the Pareto optimal solutions to resource sharing problems encountered in their ancestral evolutionary environment which likely resembles ours in important respects. These are, in the words of Daniel Dennett, "forced moves" which any evolutionary process is likely to stumble upon regardless of lineage. Artifacts, on the other hand, have no reason to be so constrained.
- unlikelymordant 10y agoFor an artifact to survive a long time, won't it also undergo a sort of natural selection? Perhaps the only long surviving ai's are those with the exact qualities you ascribe to "naturally" occurring entities. I don't think there is a reason to differentiate intelligences into any natural artificial dichotomy.
- kobeya 10y agoNot under similar selection pressures as we underwent during our evolution, and unlike natural selection it would not be limited to neighboring improvements in design space. The range of possible intelligences, and their drives, would be vastly expanded.