True, but in that case, I think it would still be difficult to swap in a completely new system into the network (with your IP) with your old private host key.

True, but in that case, I think it would still be difficult to swap in a completely new system into the network (with your IP) with your old private host key. (Without a physical breach... if that happens, all bets are off).