2 ms·
Those are not similar/comparable outcomes and I think there are two major factors that can’t be hand-waved away: 1. Consciousness. Despite advances in “intelli
by haswell 4y ago
Those are not similar/comparable outcomes and I think there are two major factors that can’t be hand-waved away:
1. Consciousness. Despite advances in “intelligence”, we still have a very limited understanding of what makes us conscious, and whether or not consciousness can emerge from machines.
If machines are not conscious and are all that remain, I’d argue everything that could be construed to have value by humans is lost, and nothing from that point forward could be considered “progress”.
2. Suffering. “Winning” on an evolutionary timescale looks nothing like the failure modes of machines taking over. The reality of this scenario is a rather grim one, and not at all like the slow emergence, competition and eventual extinction of biological species.
And depending on #1, the true tragedy of #2 begins to take shape.
I think it’d be more apropos to frame this as humanity collectively committing suicide rather than some notion of the future of progress.
If consciousness is the universe experiencing itself, what you’re describing sounds like a kind of universal death.
Of course we can’t know what consciousness really is (or if earth is the only place it exists), but that seems like all the more reason to take these problems seriously.
- luckylion 4y agoOr if consciousness is more than an illusion. Fair points. I'm not sure if you can have a general intelligence without some form of consciousness. I don't believe in gods or souls, so I lean towards us not being special. As for the how, I agree with you. I'd prefer it to not be terminators crushing heads under their iron feet while allowing us just enough room to run and hide and live in constant terror for centuries. But I doubt it will be, the power delta will be too large. It'll be like a game of Civilization where Gandhi is advancing on you with modern tanks and fighter planes while you've barely discovered the wheel.