3 ms·
Security is impossible. Therefore, "AI alignment" is impossible. I'm not sure that even AGI is possible, per Bostrom's Self-Sampling Assumption.
by ablyveiled 3y ago
Security is impossible. Therefore, "AI alignment" is impossible.
I'm not sure that even AGI is possible, per Bostrom's Self-Sampling Assumption.
- jw1224 3y ago> I'm not sure that even AGI is possible, per Bostrom's Self-Sampling Assumption. Can you explain more? I’ve found a definition for SSA, but unsure how it applies to AGI…
- ablyveiled 3y agoThe self-sampling assumption essentially says that you should reason as though your self-sampling is the likely outcome in consciousness-space-time. It's the anthropic principle applied to the distribution/shape of intelligence. Since your self-sample is of a human-shaped mind, human-shaped minds are the most likely outcome. So the probability of AGI is unlikely.