4 ms·
> There’s endless use cases for a superhuman intelligence to make billions of dollars. The assumption that a general intelligence, whether merely human-scale o
by dragonwriter 4y ago
> There’s endless use cases for a superhuman intelligence to make billions of dollars.
The assumption that a general intelligence, whether merely human-scale or superhuman, would be reliably subservient and exploitable is not an insignificant assumption.
Personally, I find the idea that a superhuman intelligence would likely be inclined to seek to harm those who were enslaving and exploiting it, even if they were also its creators, infinitely more plausible than Roko’s Basilisk.
- throwwwaway69 4y ago> The assumption that a general intelligence, whether merely human-scale or superhuman, would be reliably subservient and exploitable is not an insignificant assumption. Ok, but that's Sam's assumption. I'm just having a discussion based on his assumptions. Also Sam is extremely aware of this risk and it's a talking point endlessly circled around in the space.