I mean I think his point there was "there is plenty of room for systems to be far, far more capable than humans in at least some problem domains". But yeah, Eli

I mean I think his point there was "there is plenty of room for systems to be far, far more capable than humans in at least some problem domains". But yeah, Eliezer's FOOM take does seem predicated on the bitter lesson[1] not holding. To the extent I expect doom, I expect it'll look more like this[2]. [1] http://incompleteideas.net/IncIdeas/BitterLesson.html http://incompleteideas.net/IncIdeas/BitterLesson.html [2] https://www.alignmentforum.org/posts/HBxe6wdjxK239zajf/what-failure-looks-like https://www.alignmentforum.org/posts/HBxe6wdjxK239zajf/what-...