4 ms·
What about the political implications of AGI? This concerns me most. We need to carefully consider who exactly controls such a powerful tool and what they use
by haxel 11y ago
What about the political implications of AGI? This concerns me most.
We need to carefully consider who exactly controls such a powerful tool and what they use it for. Right now AGI is capital-intensive and risky: you need large-scale computing, top PhDs, and plenty of time. This means that only the most well-heeled organizations can justify earnest AGI development: big tech, government agencies, etc. Those orgs already have plenty of political power, and it seems to me that achieving AGI (or steps toward it) would amplify that power. Perhaps to the point of being unchallengeable.
Do we want a political landscape where power is even more concentrated than now?
- btown 11y agoThose same characteristics of capital-intensity, talent-intensity, and risk are what prevent terrorist organizations from developing nuclear weapons. The open source, deconcentrated power paradigm works for most software. But it's very possible that AGI crosses the boundary to the point where we should think of non-proliferation as being worthwhile, despite the extent to which that entrenches power structures.
- argonaut 11y agoRight now, AGI does not exist.
- haxel 11y agoNot that we know of. If it does ever exist, how long will it take for us to learn of it? Powerful tools are often kept secret. And then, how long until the average person can leverage it themselves? The most powerful tools tend not to trickle down, if it can be helped.
- argonaut 11y agoEverything you've said is just speculation. Super intelligent AI won't appear out of nowhere. There will be semi-intelligent and normal-intelligent AI first.