Yes, you're correct, the sweet spot between under- and overfitting is completely dependent on the nature of the data set, and cannot be determined a priori. Tha

Yes, you're correct, the sweet spot between under- and overfitting is completely dependent on the nature of the data set, and cannot be determined a priori. That's why cross-validation and similar techniques are critical for determining the right trade off between bias and variance.