Well, if we see an object with our eye, we know that it is on a particular line. When the brain sees the object with two eyes, it knows that the object is where

Well, if we see an object with our eye, we know that it is on a particular line. When the brain sees the object with two eyes, it knows that the object is where the two lines cross. As long as they cross in front of the eyes. If they cross in the back, the math works, but the brain is not trained for it. In spherical geometry that happens -- you see things which are just behind you, but the brain has problems interpreting that. Simulating binocular vision is not the only approach though -- you can use a perspective where the objects appear at the correct distances, some non-Euclidean VR games do this.