3 ms·
I'm not really sure what people see in the idea of hyperpersuasiveness. The relatively small intelligence differential between humans and other monkeys has led
by roenxi 4y ago
I'm not really sure what people see in the idea of hyperpersuasiveness. The relatively small intelligence differential between humans and other monkeys has led to such a difference in outcomes that we don't really need to try to persuade them. If the gap between meat's ability to handle statistics and silicon's ability to handle statistics turns out to be a similar power gap there won't be much persuading needed. Look at the gap European civilisation managed to open up over everyone else militarily through just organisational techniques.
The likely path to an AI going rogue is big country vs small country tension (say, China-Taiwan type scales). Small country gets desperate, follows some path to build autonomous, evolving AI for defence and deterrence. I can't think of a precise scenario where that would make sense, but it'll happen somewhere.
AI doesn't need to persuade its way out of the box, we just need some desperate group somewhere who's choices are annihilation or rolling the dice that an AI is a gentler overlord. There are lots of places where that is the case - the same calculus comes in to play with nukes and we see many countries nuking up over the last century - despite the fact that we're putting "end of civilisation" on the table as an option because of it.
- narrator 4y agoWe already have autonomous weapons that kill people. They're called cruise missiles. Lots and lots of really cheap drones are already spread over battlefields, but barrages of precision guided artillery seems to do as good a job as anything ever will. Why introduce AI superintelligence into the mix? Most military problems are constrained by logistics and equipment and munitions capabilities anyway.
- Isinlor 4y agoTo fix logistics, equipment and munitions capabilities?