Agreed, I think AGI->ASI. My happy radical abundance stories are happy ASI stories mostly. And therefore much less likely. BDFL / Benevolent Machine God is def

Agreed, I think AGI->ASI. My happy radical abundance stories are happy ASI stories mostly. And therefore much less likely. BDFL / Benevolent Machine God is definitely one of the ways you can get a happy attractor. Seems scary to roll the dice on. And yep, I include non-human totalitarian outcomes in the unhappy bucket.