It's technically sound though. Let me give you an example. y = f(x) = x + 2 This is what's memorized. But with that equation you can plug in a specific x.

It's technically sound though. Let me give you an example. y = f(x) = x + 2 This is what's memorized. But with that equation you can plug in a specific x. to get: 3 = f(1) = 1 + 2 The training set here would be (1,3). What is memorized is y = f(x) = x + 2. You can literally see that (1,3) is NOT in the model EVEN though that model CAN produce a (1,3) given the right input. I think the technical part of this is sound. People will just take the face value explanation which is I see a 3! therefore a THREE was memorized. But technically a 3 WAS not memorized. This is categorically true. You are Right. The persuasive part of this argument is not very good though as you can see by this thread.