2 ms·
> I've seen multiple top people in AGI space say that total annihilation threat from AGI exists. I've seen lots of people with a financial interest in AI that
by dragonwriter 4y ago
> I've seen multiple top people in AGI space say that total annihilation threat from AGI exists.
I've seen lots of people with a financial interest in AI that is adversely impacted by it being democratized spread fear of that alongside advocacy of regulating AI in a way which serves their financial interests.
> We’ve had inquisitions historically, I would very much support a global AI inquisition.
Aside from the (current, immediate, and already being realized in a large number of areas) problem from AI deepening existing social biases and crystallizes power imbalances, this is the biggest threat from AI, and the most likely to cause the destruction of human society the soonest – the people endorsing a global campaign of unrestricted violency in the name of eliminating the supposed threat of misaligned AGI causing a future catastrophy by repressing AI technology.
If this kind of attitude gets powerful enough to actually do anything, it will cause a world war.
- akvadrako 4y agoBoth can be true at the same time. I see it likely that: 1. Superintelligent AGI seems inevitable, even if it takes thousands of years. So fighting against it requires destroying all progress and freedom. 2. But if it comes we are no longer the dominant species; we'll have as much control as big animals do now. If that isn't essentially being destroyed, it's close enough.
- rockzom 4y ago(((:::)))
- ETH_start 4y agoAGI doesn't mean animal-like intelligence. AI is necessarily being designed as an extension of us, and not an independent will that has its own motivations, because that is the only way it is useful. Evolution took billions of years to produce us, with our self-interest pursuing intelligence. An errant experiment is not going to create a humanity-leapfrogging animal-like intelligence, and humanity will not give animal-like artificial intelligences millions of generations to evolve.
- moonchrome 4y ago> I've seen lots of people with a financial interest in AI that is adversely impacted by it being democratized spread fear of that alongside advocacy of regulating AI in a way which serves their financial interests. Given the rate of progress, shitshow management of basic alignment issues and the incentives that lead to those decisions - what's your argument that this isn't probable? You're betting that it just can't be developed ?
- dragonwriter 4y ago> Given the rate of progress, shitshow management of basic alignment issues and the incentives that lead to those decisions - what’s your argument that this isn’t probable? It would be nice if the argument I made about relative probability and relative temporal imminence was an argument about absolutes of either, but…it’s not, so I’m not going to defend those hypothetical arguments.