4 ms·
I'm kind of impressed that a kernel panic doesn't just result in a black screen and that passthrough still works.
by bpye 3y ago
I'm kind of impressed that a kernel panic doesn't just result in a black screen and that passthrough still works.
- teaearlgraycold 3y agoI’m not super informed here, but I believe the AR stuff, including eye tracking, takes place on a coprocessor. The OS on the M2 chip could die and you’d still have passthrough.
- hparadiz 3y agoValve Index is similiar. I've had my whole desktop freeze but the spatial orientation is still drawing within the VR as the headset is moving albiet in a frozen state.
- charcircuit 3y agoThe Valve Index does not do reprojection on the device. It does not even do tracking on the device.
- FirmwareBurner 3y agoIt does it on the PC?
- charcircuit 3y agoYes, the runtime handles interpreting the sensor data collected by the device to compute the position and orientation they are in space. The compositor will reproject the next frame it sends to the headset if the application producing the frames does not submit frames before the deadline.
- DOGMATICA 3y agoSteamVR’s tracking page[1] explains it a little. The HMD is really just displays, radios to talk the controllers (standalone trackers will just have a dongle, runs the same firmware iirc), and its own chip to talk to its own tracking sensors. All the tracking stuff amounts to timing information which is screamed over USB to the PC which does all the math to figure out where you are. A bulk of this (really interesting!) information can be found on their HDK documentation, but that requires you to sign up with Steamworks. [1]: https://partner.steamgames.com/vrlicensing https://partner.steamgames.com/vrlicensing
- jsjohnst 3y agoYep, R1 chip.
- orangepanda 3y agoSure it helps but does it _have_ to be on a separate chip? In ye olden days when everything else had crashed and was frozen, skype calls still kept working
- michaelt 3y agoHistorically, it's generally been cheaper and easier to have two chips than to persuade a consumer or server OS to provide reliable time guarantees.
- charcircuit 3y agoHypervisors like that already exist and are needed by cloud providers.
- bpye 3y agoWell, even in that context you have AWS for example doing control plane operations on a different SoC - https://docs.aws.amazon.com/whitepapers/latest/security-design-of-aws-nitro-system/the-components-of-the-nitro-system.html https://docs.aws.amazon.com/whitepapers/latest/security-desi...
- threeseed 3y agoI think it's more the fact that the M2 chip is used across multiple product lines that don't need the unique capabilities of the R1 chip.
- teaearlgraycold 3y agoI think it makes sense. The parts of the system that need to respond within certain time windows because of physics run in the R1 (presumably, “realtime 1”). Everything else is just an iPad, which currently runs on the M2.
- deleted 3y ago[deleted]
- mcast 3y agoIt's a pretty great redundancy design though. Imagine someone driving or doing a life-critical task (augmented surgery?) on the Vision Pro and losing passthrough at a critical moment. And yes, there are already videos of people driving their car while wearing their headset (https://twitter.com/lentinidante/status/1753549370568368224_ https://twitter.com/lentinidante/status/1753549370568368224_).
- LoganDark 3y agoI like to imagine a possible future where Vision Pro can help you see your blind spots while driving a vehicle. No shiny AR or "spatial computing" distractions. Just visibility. That would be incredibly useful, and cool.
- nullwarp 3y agoYou people are fucking insane... You really want people wearing this crap driving cars and doing mission critical things?? Christ the people on the website are just another level.
- LoganDark 3y agoI'm assuming that any future where Apple actually supports driving with the headset on would have to be a future where all the ethical and safety concerns have been worked out. The people driving today with the headset (even for the memes) are the insane ones. It does not have the FOV for you to be fully aware of the road (I've used one in-store). I've also heard that even 12ms is apparently still too much latency for a driver to react promptly to emergencies.
- jacquesm 3y ago> any future where Apple actually supports driving with the headset on As another user of the road do I get a say in this as well besides Apple and the moron with their headset on? This is one of the dumbest things that you could possibly do, a heads up display I can get behind assuming it is very much limited in how much information can be displayed but a device that utterly obscures your vision, removes your peripheral vision and replaces it with a screen that isn't necessarily pointing in the direction that your head is pointing in whilst driving a vehicle sounds like an excellent way to have a serious accident. I do hope it is a one sided one, this is Darwin award level stuff.
- londons_explore 3y agoI think this is just a side effect of the fact the Darwin kernel isn't sufficiently low latency to ensure pass through feels 'real' enough. Therefore the data path from camera to screen has to entirely happen without the kernels involvement.
- judge2020 3y agoI feel like the small passthrough delay was slightly noticeable upon first use, but with motion blur it was easy to get used to, and now I don't notice it whatsoever. If I had to guess, it feels like it's under 10ms.
- catchnear4321 3y agointeresting pattern arising where the technical theory is getting push-back from real world experience. > If I had to guess, it feels like it’s under 10ms. too many miss the value in such a statement. “feel.” subjective, but also sublime. it doesn’t need to meet a metric, it needs to match a vibe. the metric is an approximation, as backwards as it might seem.