4 ms·
One of the more eerily plausible scenarios I've seen: https://www.lesswrong.com/posts/pk9mofif2jWbc6Tv3/fiction-a-disneyland-without-children https://www.lessw
by Jordan-117 9d ago
One of the more eerily plausible scenarios I've seen:
https://www.lesswrong.com/posts/pk9mofif2jWbc6Tv3/fiction-a-disneyland-without-children https://www.lesswrong.com/posts/pk9mofif2jWbc6Tv3/fiction-a-...
Basically: as AI becomes more embedded in everything, the economy becomes more and more geared towards serving and expanding AI companies and infrastructure at the cost of human welfare, until it completely decouples from the priorities of everyday people. A combination of irresistible financial incentives, regulatory capture, propaganda, and autonomous robotic workers/security perpetuates this system even as the populace begins to actively revolt. The disempowered human population is marginalized and eventually starved out both economically and literally, while the automated economy continues to putter along blindly pursuing line-upping activities that serve no purpose any more.
We're already seeing signs of this in how the electronics industry is steadily abandoning the consumer sector to cater to hyperscalers, which themselves are encroaching on towns and sucking up resources through backroom deals despite widespread public opposition. Or look at how attempts to internally wrangle OpenAI were defeated by Silicon Valley power plays. But really it's just a progression of the K-shaped economy meme (more and more of the economy profitably catering to the ultra-wealthy while everyone else languishes). Or capitalism as a whole -- just look at how we've already been destroying the sustainability of the planet in pursuit of short-term profit. AI is just accelerating that process and further undermining guardrails against it.
It all comes down to the idea that corporations and capitalism are early-stage forms of AI and the singularity, breaking free of human control and pursuing their basic reward function even if it threatens human well-being and survival. Until now it's been a class-war thing where the system perpetuates through greed and ambition (and the reliance on humans to function keeps it at least somewhat in check), but the idea of putting management, capital, the means of production, and state violence under the control of unaligned superintelligence is disturbing.