One of the issues here is the content isn't tied directly to the pixels in the display. You have competing rasters: the raster of the input video (or desktop re

One of the issues here is the content isn't tied directly to the pixels in the display. You have competing rasters: the raster of the input video (or desktop rendering), and the raster of the display device. They don't necessarily interact in a nice way. That's actually the reason VR experiences seem so low-rez (well, among many others) despite having high resolution displays.