4 ms·
Why cause harm? Basically, by accident. If you try to solve a problem really hard, and you're really good at it, and you aren't also trying very hard to prese
by NumberWangMan 4y ago
Why cause harm? Basically, by accident. If you try to solve a problem really hard, and you're really good at it, and you aren't also trying very hard to preserve a bunch of things that are important to humans, you're very likely to destroy a lot of things that are important to humans in the process.
100 times the computational power may be... 2 years out, at the rate we're going. GPT-4 has about 500 times as many parameters as GPT-3, and that was released 3 years ago. The amount of power people are dedicating to these is following an exponential track.
It's not about it causing harm -- I think most people have accepted that. It's that we may make an AI that's so smart, so good at everything, that trying to control it is like me playing chess against Stockfish. If it gets to that point, and it happens to have learned a goal / set of goals that aren't 100% friendly to humanity (which seems like an inevitability based on our current abilities at AI alignment) then it will optimize those goals so hard that we all die in the process. We'll end up with a planet with all silicon turned into solar panels and computing power, and probably all other elements put to the use of the AI as well.