3 ms·
For every point except AI takeover, I agree. AI takeover isn't well defined, and by extension it isn't assured to be sensible — if a narrow AI is made to optim
by ben_w 4y ago
For every point except AI takeover, I agree.
AI takeover isn't well defined, and by extension it isn't assured to be sensible — if a narrow AI is made to optimise the heck out of [high contagious, short latency period, long incubation period, high lethality, can form stable reservoirs in other species], it can be good at that without any long term planning about what happens next.
Conversely, we can also consider one that solves Von Neumann replication, and then it's less than a century to disassemble the planet Mercury, and from there a week or two for each of Venus and Earth. Assuming it had that as a goal.