I simply disagree on that specific definition of ASI. Sure, what we're both describing is a system that is able to self-improve at a rapid rate. But, what does

I simply disagree on that specific definition of ASI. Sure, what we're both describing is a system that is able to self-improve at a rapid rate. But, what does "improve" mean? Is an AI which is able to rapidly self-improve only along the intelligence vertical of making the best sourdough bread actually ASI? > We haven't built something that can self improve continuously yet. Actually, we have. Its called AlphaGo; its capable of rapid self-improvement on the intelligence vertical of playing Go. Is that ASI? If your answer to that is No, then you've accepted the base case of a more general idea: That the vertical of self-improvement does matter in the human designation of ASI, which means the objective and reward functions defining "ASI" are at some level human designated. In other words, it is deeply related to what humans want.