"The researchers invented an AutoML system that trains only a single, large 'once-for-all' (OFA) network that serves as a 'mother' network, nesting an extremely

"The researchers invented an AutoML system that trains only a single, large 'once-for-all' (OFA) network that serves as a 'mother' network, nesting an extremely high number of subnetworks that are sparsely activated from the mother network. OFA shares all its learned weights with all subnetworks — meaning they come essentially pretrained. Thus, each subnetwork can operate independently at inference time without retraining."