2 ms·
Aside from the fact that the entire argument is grounded in abstract ivory-tower omphaloskepsis and not facts in the real world, a major problem with Yudkowsky’
by dragonwriter 4y ago
Aside from the fact that the entire argument is grounded in abstract ivory-tower omphaloskepsis and not facts in the real world, a major problem with Yudkowsky’s argument is that trying to execute the preemptive Butlerian Jihad he recommends is something that actual, real-world experience tells us:
(1) Will kill a lot of people directly in the best case,
(2) Won’t actually succeed in preventing further development of AI in any case, and, therefore, to the extent his concerns are grounded won’t solve the problem it intends to,
(3) Will kill a lot of people indirectly, in the best case, by setting back (and in some cases, winding back) progress in every field of practical use of technology through limits on information and information technology,
(4) Has a fair chance of the violence it necessarily involves spiralling out of control, potentially destroying the human race, as it is unlikely that all societies, or, particularly, all nuclear powers, will sign on to “we must smash the thinking machines”, and those who do not will take those who do trying to forcibly enforce their Luddism as an existential threat, while those who do will take the resistance the same way.