Only skimmed the bullet points, but one that’s missing and seems important to me is: * The marginal utility of intelligence may not be so great. If you are alr

Only skimmed the bullet points, but one that’s missing and seems important to me is: * The marginal utility of intelligence may not be so great. If you are already really smart, is there any point to being smarter? Most interesting problems are NP-complete. If you are really smart you can solve a big NP-complete problem. But how much smarter do you need to be to solve a slightly bigger (and therefore more interesting) problem? Well, twice as smart or something. Being just a little bit smarter gets you nothing. So (in this case) the marginal utility of intelligence approaches zero as your AI gets more intelligent.