It's hurting my brain to think about this. Surely if you aren't looking into the lens then your eyes will not appear as if they are looking at the person since

It's hurting my brain to think about this. Surely if you aren't looking into the lens then your eyes will not appear as if they are looking at the person since the lens's perspective is the source for the projection on the other side. Like, if I take a picture of myself with a camera and look directly into the lens then my eyes are pointing directly forward. If I now continue looking at that same point but move the camera up on a step-ladder, the image I am going to get would not have my eyes aligning directly into the camera. How do you get around that?