The key in that case is that the other reference frame that from our reference frame will measure a different distance to the black hole. It might be 25000 ligh

The key in that case is that the other reference frame that from our reference frame will measure a different distance to the black hole. It might be 25000 light years away from them, but we would not be 25000 light years away (but longer I believe) in their reference frame. This can happen for instance with extreme differences in relative velocities. Someone else can probably show an example with the math, but a key concept here is the that distances also change when you move real fast or are in a deep gravity well.