Yes usual results in statistical learning theory are upper bound on the generalization error, so if you have an "overparametrized" (number of parameters is actu

Yes usual results in statistical learning theory are upper bound on the generalization error, so if you have an "overparametrized" (number of parameters is actually a useless metric but that's another discussion altogether) then the best you can say is "well I expect the error to be at most A FREAKING LOT", which is not a very interesting result.