5 ms·
What's the necessary resolution in each eye needed to be "retina"? Once we reach that will it be the end of the "monitor era"? A lot of interesting things can h
by endisneigh 6y ago
What's the necessary resolution in each eye needed to be "retina"? Once we reach that will it be the end of the "monitor era"? A lot of interesting things can happen once you no longer need monitors. Though sharing with others will still be a practical limitation so I doubt they'll go anywhere for now.
Once you no longer have monitors I think there will have to be a UI and UX shift around how you interact with things. Windows made sense because you had a fixed set of boundaries. If the boundaries no longer exist it probably doesn't make sense to have windows in the traditional sense anymore. You could have an infinite set of context sensitive menus that appear as necessary.
- hetman 6y agoI feel like the windows are there to create context for the human brain, not because they resemble the shape of the screen. These context may look a little different to windows, but I don't think they will be radically different in principle and will still maintain a distinct resemblance to the physical world. That's what our brains are moulded to best interface with after all.
- Strom 6y agoDepends on the field of view angle you want to achive, but 8K is unlikely to be enough. Back in 2015 Michael Abrash said: In order for it to have retinal resolution across a field of view of 180 degrees it would have to have something on the order of 16K by 16K resolution [per eye]. [1] -- [1] https://youtu.be/UDu-cnXI8E8?t=4232 https://youtu.be/UDu-cnXI8E8?t=4232
- bostonsre 6y ago> Apple will liberally use an already-known VR technique that involves using eye-tracking to render objects in the user's periphery at a lower fidelity than what the user is focusing on. Should be enough if they don't have to render that full view, but only what the retina is focusing on I would think.
- jacquesm 6y agoWhich suggest and interesting solution: a very small high res display surrounded by much lower res areas that can move around in such a way that it always sits right where the eye is looking.
- spaethnl 6y agoI think it would be easier, more reliable, and more energy efficient to wait for microled displays, which seem to be right around the corner. I get the impression that they might be available by the end of the year or next year, and might be something Apple has access to?
- xsmasher 6y agothat solves the gpu problem of high-resolution rendering and the bandwidth issue, but is the density of pixels in the display enough to fool the eye?
- dsr_ 6y agoA field of view about 180 degrees wide, 135 degrees high, 1 arc minute in maximum pixel size, and updated 100 times per second… twice, to account for full stereography, and using 48 bits of color. 180 * 135 * 60 * 60 * 100 * 48 = 419904000000, 420 billion bits per second, without compression.
- zamalek 6y agoKeep in mind that the 90FPS benchmark is merely required to achieve "presence," which is the phenomenon of the brain accepting the virtual reality as reality. Higher framerates are always beneficial (as this also reduces latency). > 420Gbps I assume foveated compression (a pet idea of mine that I have no doubt someone else also has) is probably the only way to realistically deliver the stream to the HMD (assuming that some rendering pipeline that can deliver the uncompressed stream exists). You also have to be concerned about micro-saccades, which may increase the effective resolution of the eye.
- dsr_ 6y agoRight, 420Gb/s is the worst-case number. If you can track the fovea accurately, at 100 Hz you need to keep at least a 9 degree circle at full resolution -- more likely an 18 degree circle -- and even so, there's no mechanical system likely that's going to keep up with that motion, so you need a display screen at full resolution across the entire surface, even if you're only painting full resolution across a small sector each frame. Also also note: there's head motion to track and events to respond to. If you're playing a movie, that's pretty much your best case because you only have to pan and tilt a stream of things you already know about. Playing a game is medium bad, because you can predict the range of possible events. Doing AR mediation is worst, because you can't predict the rest of the universe.
- mparramon 6y agoWhen you say "foveated compression" do you mean >Apple will liberally use an already-known VR technique that involves using eye-tracking to render objects in the user's periphery at a lower fidelity than what the user is focusing on. ?
- iandanforth 6y agoAbout 3000ppi Example headset that used a small display with this pixel density. https://arstechnica.com/gadgets/2019/02/retina-resolution-headset-puts-the-reality-into-virtual-reality/ https://arstechnica.com/gadgets/2019/02/retina-resolution-he...