I'd like to propose the name "Clippy's Wager" for the utility-maximization problem the AI in the story faces. The situation is an AI which has gained self-awar

I'd like to propose the name "Clippy's Wager" for the utility-maximization problem the AI in the story faces. The situation is an AI which has gained self-awareness and thru its learning process is meta-learning about what kind of behavior will maximize its utility reward function. It recognizes that it might be the sort of AI whose utility reward function can reach near-infinite value if it will take over the world and dedicate the world's resources to meeting the AI's aims. Even if this possibility is assigned very tiny likelihood, the near-infinite payout associated means it is a very attractive direction for optimization. This is analogous to Pascal's Wager, where Pascal (coming from a largely Christian culture) is familiar with the idea that there may be a God who will grant eternity in Heaven for believers or eternity in Hell for non-believers. Even if this possibility is assigned very tiny likelihood, the infinite payout associated means it has infinite importance. Pascal concludes that belief in God must be justified.