4 ms·

What does it mean for an "advanced intelligence" to want "personal autonomy"? We only know what personal autonomy means as it pertains to persons, and we have n

What does it mean for an "advanced intelligence" to want "personal autonomy"? We only know what personal autonomy means as it pertains to persons, and we have never encountered any other advanced intelligence other than ourselves. Why do we assume that "advanced intelligence" necessitates any attributes or characteristics of personhood? This sounds dangerously close to committing the fallacy that intelligence is what makes persons. We don't know what it will be like to be an AI, just like we don't know what it's like to be a bat.

neodypsis 4y ago
People think AGI will behave like Mewtwo the Pokemon, but we can only speculate how a super intelligent being will behave.
- 8note 4y ago
  As far as how one based on an LLM might behave, that's likely not too far off, since the way Mewtwo behaves is part of it's training set
  - neodypsis 4y ago
    We have never known a super intelligent being. My personal believe is that it will be benevolent.