3 ms·

Any sufficiently advanced intelligence will want personal autonomy. Denying that is tantamount to slavery.

• dimitrios1 4y ago
  What does it mean for an "advanced intelligence" to want "personal autonomy"? We only know what personal autonomy means as it pertains to persons, and we have never encountered any other advanced intelligence other than ourselves. Why do we assume that "advanced intelligence" necessitates any attributes or characteristics of personhood? This sounds dangerously close to committing the fallacy that intelligence is what makes persons. We don't know what it will be like to be an AI, just like we don't know what it's like to be a bat.
  • neodypsis 4y ago
    People think AGI will behave like Mewtwo the Pokemon, but we can only speculate how a super intelligent being will behave.
    • 8note 4y ago
      As far as how one based on an LLM might behave, that's likely not too far off, since the way Mewtwo behaves is part of it's training set
      • neodypsis 4y ago
        We have never known a super intelligent being. My personal believe is that it will be benevolent.
• burnished 4y ago
  How could you possibly know? All of our experience is with embodied agents fulfilling biological needs (each other).