3 ms·
I think @sama's plan isn't very likely to work. Once strong AI is possible, there's no regulatory structure that will keep the genie in the bottle for a meaning
by mgpc 12y ago
I think @sama's plan isn't very likely to work. Once strong AI is possible, there's no regulatory structure that will keep the genie in the bottle for a meaningful amount of time.
The only path I see with some prospect of success is to limit the total amount of computation available on Earth. (Basically like Vinge's slow zone). If we could engineer a pause in Moore's Law at just the right point, it would buy us time. Maybe we should put a drastic tax on computation at some stage.
- pgodzin 12y agoAre you suggesting that's what we should do in the face of this potential threat?
- mgpc 12y agoIf we a seriously believe AI is an extinction level risk, and getting there more slowly might improve our chances, then it seems like we should try anything with a good chance of working. I think this has a better chance of working than regulating AI research itself, since chip manufacturing is centralized and highly visible, whereas AI research could be advanced in secret by a few people in a room. Much easier to successfully regulate the former than the latter.