4 ms·
> "as smart as we are, and given the constraints of the physical world, is there room for a hypothetical 'smarter than human AGI' to represent an existential th
by nshepperd 11y ago
> "as smart as we are, and given the constraints of the physical world, is there room for a hypothetical 'smarter than human AGI' to represent an existential threat, or something that justifies the analogy to nuclear weapons?"
The answer is still yes. Your "thinking out loud" is privileging an already refuted hypothesis.
- mindcrime 11y agoThe answer is still yes. Well that's a fine assertion, but how do you justify it? Your "thinking out loud" is privileging an already refuted hypothesis. WTH does that even mean? There is no hypothesis, there's a vague notion of an area to consider, which - if considered thoroughly - might or might not yield a hypothesis.
- nshepperd 11y agoAs I said, Nick Bostrom's Superintelligence talks all about this. The main thing is that the constraints of the physical world are nowhere near the limitations of human capabilities. Yes, there's a theoretical limit to how much computation you can do in a certain amount of space with a certain amount of energy. No biology or technology currently in existence even gets close to those limits. Without any such fundamental limit there's just no reason for AGI not to present a threat. But there is lots of other evidence too.
- mindcrime 11y agoI've been planning to read Superintelligence for a while anyway, so I think I'll move it up the list a bit in response to all this discussion. I'm on vacation once I check out of here today, until the second week of Jan, so I'll probably read it over the holiday.