3 ms·
> We'll end up idle, dependent on sociopathic programs to get fed, or not. Maybe. It's impossible to predict what an AI "wants". Maybe it wants to feed humans
by jfoutz 11y ago
> We'll end up idle, dependent on sociopathic programs to get fed, or not.
Maybe. It's impossible to predict what an AI "wants". Maybe it wants to feed humans to lions for entertainment. Maybe it wants to convert the entire planet to a paper clip factory. Maybe it wants to create utopia for its humans. Maybe earth is boring and it leaves.
The current thought experiment that creeps me out is an AI with two desires - "don't manipulate humans", "it's good when humans believe things that are true". So, the AI makes the world into something that matches human beliefs.
- pygy_ 11y ago> Maybe it wants to create utopia for its humans. ... and the best way to minimize human suffering, in the long run, is to kill everyone, as fast as possible. ———————— . ———————— Edit, to make things clear, I'm not advocating for that, it's just an example of how a benevolent ideas carried to their logical end turn out not to be desirable.
- SolaceQuantum 11y agoThe idea that the minimization of human suffering is death implies that being dead isn't itself something that is inherently should be avoided.
- pygy_ 11y agoFrom stage left, enter euthanasia.