It seems like an AGI would just be a meta-machine-learning model, meaning it's a model whose whole goal is to think up new ways of training models. Eventually,

It seems like an AGI would just be a meta-machine-learning model, meaning it's a model whose whole goal is to think up new ways of training models. Eventually, it would figure out a way to either incorporate the smaller, specialized subtasks into itself and piecemeal upgrade itself. Oh, and it needs permission to use $MEGA_DOLLARS to run the computations necessary for training. So, it would probably need a side hussle. Like search ads or something. Right now, humans are either the bailing wire or the chewing gum in this situation, but they hold the purse strings and GPU farms. Humans are the ones thinking up new training strategies, curating the learning datasets, and building the cluster and cloud and datacenter systems that can handle that much data.