3 ms·
> Why would an AI care what moneyed interests care about? A General AI won't necessarily. Quoting Adreessen, software is eating the world, in that more and mo
by pygy_ 11y ago
> Why would an AI care what moneyed interests care about?
A General AI won't necessarily.
Quoting Adreessen, software is eating the world, in that more and more jobs are being replaced by computer systems some smarter than others. The programs don't need to be generally intelligent to beat humans as long as they are better in their specific domain.
Farming is being automated with self-driving tractors, and the same goes for some mining operations.
Some fields/jobs also exist only thanks to computers. Google or weather forecasts couldn't be done with pens, paper and telephones.
Meanwhile, we're gradually losing the skilled work force.
If at some point, programs are better at driving a company or a country than people (and it will happen), they'll be put in charge.
> There's been no selection bias, yet.
Yet. At some point, there will be, and the most resilient will survive and proliferate, while the others will not.
We'll end up idle, dependent on sociopathic programs to get fed, or not.
- jfoutz 11y ago> We'll end up idle, dependent on sociopathic programs to get fed, or not. Maybe. It's impossible to predict what an AI "wants". Maybe it wants to feed humans to lions for entertainment. Maybe it wants to convert the entire planet to a paper clip factory. Maybe it wants to create utopia for its humans. Maybe earth is boring and it leaves. The current thought experiment that creeps me out is an AI with two desires - "don't manipulate humans", "it's good when humans believe things that are true". So, the AI makes the world into something that matches human beliefs.
- pygy_ 11y ago> Maybe it wants to create utopia for its humans. ... and the best way to minimize human suffering, in the long run, is to kill everyone, as fast as possible. ———————— . ———————— Edit, to make things clear, I'm not advocating for that, it's just an example of how a benevolent ideas carried to their logical end turn out not to be desirable.
- SolaceQuantum 11y agoThe idea that the minimization of human suffering is death implies that being dead isn't itself something that is inherently should be avoided.
- pygy_ 11y agoFrom stage left, enter euthanasia.