Not just the North Star, of course, but yeah, they know where certain stars should be and compare what they see. The Trident Missile (sub launched missile) use

Not just the North Star, of course, but yeah, they know where certain stars should be and compare what they see. The Trident Missile (sub launched missile) uses it in conjunction with inertial nav to correct its course mid-flight.