3 ms·
> The near term risk isn't super intelligence, it's the paper-clip optimizer pushing the wrong button. This has already happened. The paper clip optimizer was
by avgcorrection 3y ago
> The near term risk isn't super intelligence, it's the paper-clip optimizer pushing the wrong button.
This has already happened. The paper clip optimizer was capitalism.
Just listen to some heatwave weather forecasts once in a while (as an example).
- staunton 3y agoThere may be more than one thing. Capitalism as an information processing system is quite slow. Computers can be faster.
- avgcorrection 3y ago“Already happened” merely means that it is not a hypothetical scenario any more.
- lukifer 3y agoTo anyone who says we can just flip the off switch on AIs who go rogue: where exactly is the off switch to capitalism, or corporations, or global supply chains, or industrialized agriculture, or social media, or the State? AIs aren't a new phenomenon: we've been co-evolving with them for millennia, for both good and ill. The new more powerful iterations ("vast arrays of inscrutable floating-point matrices") are nested in those previous memetic life forms (corporations in particular [0]); and once something becomes infrastructure (and/or an income stream to some subset of humanity), it becomes non-trivial, if not impossible, to turn off. [0] https://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre-soaking-in-it.html https://omniorthogonal.blogspot.com/2013/02/hostile-ai-youre...