4 ms·
I don't see that the cognitive capacity of humans relative to AGI would prevent such trade anymore than the cognitive capacity of e.g. dogs prevent trade betwee
by aidenn0 3y ago
I don't see that the cognitive capacity of humans relative to AGI would prevent such trade anymore than the cognitive capacity of e.g. dogs prevent trade between humans and dogs. It's not a relationship with equal power, but there is some level of reciprocity there.
- TheOtherHobbes 3y agoDogs and humans are relatively close. Humans and AGI might not be so close. It depends where the S curve for AGI plateaus. It might be somewhere relatively comprehensible, or it might be far beyond that. If it's the latter no trade is possible. AGI is going to be doing things we literally can't begin to imagine, driven by motivations we literally can't begin to imagine, using super-meta-everything conceptual engineering we literally can't begin to imagine. There may be some perceptual fall-out for us to experience, but we won't have any idea what it means. If this isn't obvious, consider that humans have symbolic abstraction skills which other animals (mostly) lack. What's the next type of skill up from that? You could say something like much broader and deeper pattern recognition, the ability to handle far more percepts at once, and so on. But those are still qualitatively familiar. They're just human skills improved. What would an entirely different super-class of skills and abilities look like? It's impossible for us to answer that.
- aidenn0 3y agoI stated elsewhere (after your reply) that a human-created AGI is likely to have at least vestigial ability to communicate with humans, since humans seem to want very much to communicate with AIs.