These are very good points! Current theories of reason are obviously assuming human minds. Still, even if one wants to create a new definition that includes AGI

These are very good points! Current theories of reason are obviously assuming human minds. Still, even if one wants to create a new definition that includes AGIs, there has to be some concept of agency, of wanting to achieve something, with the capability being the means to that end. The capability alone isn't what brings us closer to AGI.