3 ms·
Because they believe the results are not the same regardless. AGI's impact on humanity will hinge upon if we are able to correctly impart human-loving values on
by reducesuffering 3y ago
Because they believe the results are not the same regardless. AGI's impact on humanity will hinge upon if we are able to correctly impart human-loving values onto what is essentially an unhuman system, so called "alignment." If we align AGI, it will make us obsolete but atleast give us a good life. If we don't, and it has goals it wants and the superpower to subvert our attempts to thwart its goals, we will end up as ants are to Google. Not hated, but a tiny nuisance to be disregarded when a new data center needs to be built. The only defense is slowing down AI capabilities until alignment has been rigorously verified.