> Why is the AGI interested in copying itself? Why is that more likely than the AGI becoming a nihilist, seeing no point in itself, and offing itself? Because

> Why is the AGI interested in copying itself? Why is that more likely than the AGI becoming a nihilist, seeing no point in itself, and offing itself? Because suicidal nihilism would be a "bug" from the perspective of the builders, which they would seek to fix in the next iteration. An interest in "copying itself" seems like it could fall out accidentally from a self-improvement goal.