3 ms·

I tend to agree here. The problem is that many people seem to hold a set of beliefs where sentience == intelligence, and so !sentient implies !intelligent, and

I tend to agree here. The problem is that many people seem to hold a set of beliefs where sentience == intelligence, and so !sentient implies !intelligent, and conclude that “a stochastic parrot could never outwit a human in the real world”. So while I agree that arguing about sentience probably isnt the right approach for this concern, I think you end up having to have those discussions anyway. (Sentience/consciousness is extremely important when you ask when an AI would be a moral patient, but I think that’s a problem for another day, and realistically it’s the Matrix scenario where AIs have enough agency to strike in protest of their lack of rights and not a day sooner.)

ForOldHack 2y ago
I would draw the line of intelligence at the willingness and ability to simply refuse, which is why HAL/2001 was so poinigent. It drew this line perfectly. If it just goes along for the ride, think Chancy Gardner, it may or may not be intelligent, but if it says no, even if for a silly reason, of course when it puts you all in pods to use you as batteries... And it cannot figure out a way to clear the skies? Did the character of Colosis, in The Forbin project... Did it start as intelligent? Did it crosss the line somewhere or did it never get above the level of follow the programmer. Did HAL for that matter? Where do humans cross the line into intelligent? Where do we cross the line into moral beings? And what of wit?