Overfitting isn’t binary. Plenty of cases where something has overfit a bit and has a hard time generalizing to inputs in the distribution far from the limited

Overfitting isn’t binary. Plenty of cases where something has overfit a bit and has a hard time generalizing to inputs in the distribution far from the limited training set, but is good at things near its distribution but unseen before. That’s what’s happening here.