4 ms·
Yes, well, even when taking that kind of weird stuff seriously we're not all that far from certainty that it won't work out like that in real life. For example
by Vecr 2y ago
Yes, well, even when taking that kind of weird stuff seriously we're not all that far from certainty that it won't work out like that in real life.
For example, why would you want to keep around a creature that can Gödel attack you, even if you're an ASI? Humans not being wholly material is more incentive to wipe them out and thus prevent them from causally interacting with you, not less.
- swayvil 2y agoKill the guy with the key to your prison cell because he might interfere with your position as king of the cell? Absurd. On a similar note, you ever read Egan's "Permutation City"?
- Vecr 2y ago> Kill the guy with the key to your prison cell because he might interfere with your position as king of the cell? Absurd. I think the basic logic makes sense, it's sort of analogous to the ultimatum game in game theory. I don't know any good theories of rationality that suggest taking bad deals in the ultimatum game, even if in theory they "get you out" of the universe somehow. On Permutation City, well, I'm somewhat skeptical of how it was written to work.