Over-fitting is a known problem and deliberately avoided. This does not prevent the curve from intersecting an actual training set. I mean technically, if ther

Over-fitting is a known problem and deliberately avoided. This does not prevent the curve from intersecting an actual training set. I mean technically, if there are many copies of the same data set pair, THEN you can call it over-fitting. But removing that does not fully remove the problem. The curve will still intersect datapoints EVEN without over fitting. Also over-fitting is not memorization.