I think what happens is that during the active learning part you heavily overfit and end up in a local minima. Afterwards life acts like a regularisation, and w

I think what happens is that during the active learning part you heavily overfit and end up in a local minima. Afterwards life acts like a regularisation, and when you return to it you are no longer in a minima but now have a gradient to descend on again.