4 ms·

there's also the issue that most of the AI catastrophizing is a pretty clear slipperyslope argument: if we build ai AND THEN we give it a stupid goal to optimi

there's also the issue that most of the AI catastrophizing is a pretty clear slipperyslope argument: if we build ai AND THEN we give it a stupid goal to optimize AND THEN we give it unlimited control over its environment, something bad will happen. the conclusion is always "building AI is wrong" and not "giving AI unrestricted control of critical systems is wrong"

mikea1 3y ago
I completely agree that's a valid argument. I just think it is rational for someone to come to a different conclusion, given identical priors.
- parpfish 3y ago
  If it wasn’t clear, I agree with your parent comment
  - mikea1 3y ago
    My main takeaway from Bostrom's Superintelligence is that a super intelligent AI cannot be contained. So, the slippery slope argument, often derided as a bad form of logic, kind of holds up here.
olddustytrail 3y ago
The massive flaw in your argument is your failure to define "we". Replace the word "we" with "a psychotic group of terrorists" in your post and see how it reads.
- actionfromafar 3y ago
  Or "board of directors beholden to share-holders".
- parpfish 3y ago
  If you’re talking about some group of evildoers that deploy ai in a critical system to do evil… the issue is why do they have control to the critical system? Surely they could jump straight to their evil plot with the ai at all
  - olddustytrail 3y ago
    Your question is equivalent to "if you have access to the chessboard anyway, why use Stockfish, just play the moves yourself."