Steve Omohundro has written on this topic, predicting that a certain set of features (termed Omohundro Drives) will appear in all sufficiently advanced AIs. ht

Steve Omohundro has written on this topic, predicting that a certain set of features (termed Omohundro Drives) will appear in all sufficiently advanced AIs. https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf https://selfawaresystems.files.wordpress.com/2008/01/ai_driv...