I think... flipping it around a bit, for this to be a reasonable response, then it must be a grave threat to humanity, and you want to be really sure. It's rat

I think... flipping it around a bit, for this to be a reasonable response, then it must be a grave threat to humanity, and you want to be really sure. It's rational to be wary of beliefs that lead you to drastic actions like this, as people have done bad things in history in the name of fear. But it's also very possible that such an instinct, to doubt yourself, could be what dooms us. I really don't want it to be true, that AI is such a threat that drastic action like you mentioned is necessary (probably minus the solitary confinement thing for AI researchers -- if you can control the chips, and give them a stern warning not to do AI research backed up by penalties, we're probably fine). It's terrifying if we're facing something that will end us, and the only option is to essentially go scorched earth on computers. People will naturally recoil from the idea that AI is such a threat, BECAUSE it would warrant an extreme response. Regardless of whether it is actually a threat or not. If AI does not have the potential to doom us, that's great. If we take drastic action and it wasn't going to doom us, however, that's very regrettable--this is what most of us worry about. But if it does pose an extinction threat, and we don't take it seriously, that's even more regrettable. I think the latter option is far more likely at this point, just based on human nature and our tendency to poke the bear. I've basically reached the point where I don't know what I could possibly do, and I'm pretty much shut down. I'm trying very hard every day not to think about this, but as you can see from the fact that I'm typing about this, I don't always succeed. I'm just trying to enjoy what may be the last few years I have left with my family before the world goes nuts. But anyway, except for punishing people unnecessarily as I mentioned above, I think that what you suggested is reasonable.