4 ms·
I wonder if some of the latency could be soaked up by a physical adaptation of the display panel. Imagine a display that adjusts position manually/mechanically
by kator 14y ago
I wonder if some of the latency could be soaked up by a physical adaptation of the display panel. Imagine a display that adjusts position manually/mechanically in relation to the head movement, enough to give the latency time to catch up with the underlying movement. People won't just sit in a chair and spin 360 constantly. If the physical display could shift the angle of view or the pan/scan of viewable pixels perhaps the rendering could happen a bit slower and catch up when the user stops for a second to focus etc.?
You could render a 'latency' buffer past the edges of the panel's physically viewable viewport and then the panel could expose that zone along with head movement while the rendering continues to work on catching up with the actual shift. When the head comes to a stop for even a handful of milliseconds the display can recenter while the scene is rendered to "time current" position.
- kator 14y agoHmm on second thought you could also just render the "overscan" and have the IMU work with the display to shift the pixels into view while the processor works to keep the overscan updated. On pause you can re-render everything (overscan included) and start all over again on the next movement. +------------------------------+ | <<< "over scan area" >>> | | +----------------------+ | | | viewable by user | | | | | | | | | | | | | | | | | | | +----------------------+ | | <<< "over scan area" >>> | +------------------------------+ This might leave enough "headroom" too keep up with potential movements at very low latencies.
- andybak 14y agoEye tracking would allow even more latitude. The eye picks up very little detail outside of the central area of focus. It is also very good at inventing information to fill in any gaps - for example during the periods when the eyeball shifts position we are essentially blind but the brain fools us that we see a continuous image.
- ahoge 14y agohttp://en.wikipedia.org/wiki/Saccadic_masking http://en.wikipedia.org/wiki/Saccadic_masking
- tellarin 14y agoThanks for the link! I had to go to the mirror and try the little experiment described in the intro. Not totally convinced yet, gotta try with someone as witness. ;)
- wcoenen 14y agoIn Peter Watts' scifi novel "Blindsight"[1] there is a description of aliens which could program their bodies on the fly to move only during the saccades of one human observer in order to hide themselves[2]. [1] https://en.wikipedia.org/wiki/Blindsight_(Watts_novel) https://en.wikipedia.org/wiki/Blindsight_(Watts_novel) [2] http://www.rifters.com/real/shorts/PeterWatts_Blindsight.pdf http://www.rifters.com/real/shorts/PeterWatts_Blindsight.pdf page 236
- biesnecker 14y agoWhat an awesome concept! Thanks for the link, I think I'll be adding this to my reading list.
- RobotCaleb 14y agoI love that book so much. I recommend it often but nobody ever takes me up on it.
- mdonahoe 14y agoI'm am skeptical of this solution, because in VR, when you turn your head, all the angles change. It is more complicated that just shifting the image.
- jessriedel 14y agoMight work to first order, though. Could make the effects much smaller.
- acous 14y agoCarmack talks a bit about one optimization he used in the doom 3 demo: https://www.youtube.com/watch?v=wt-iVFxgFWk#t=1h51m45s https://www.youtube.com/watch?v=wt-iVFxgFWk#t=1h51m45s