3 ms·
This device is going to have color passthrough vision. That means it has cameras on the outside, and then an image of the real world is shown on the inside. If
by fshbbdssbbgdd 3y ago
This device is going to have color passthrough vision. That means it has cameras on the outside, and then an image of the real world is shown on the inside. If you try to just directly display the video from the camera on the screen inside the user will throw up. You need to do a lot of processing to reconstruct what the user’s eyes need to see on the inside display, which probably includes a stack of analytic methods and ML inference that has to run in real-time and produce high-resolution video signal. Trust me that the engineers working on this are absolutely pushing the limits of what their hardware can do. The tradeoff space would include the following factors:
1) low quality passthrough is unpleasant
2) heavy headset is unpleasant
3) headset with weight imbalance is unpleasant
4) sensors, chips, and display all use power
5) battery with more capacity is heavier
6) battery with more power draw is hotter
7) hot headset in your face is unpleasant
8) battery at the end of a cord is ugly and annoying
So it’s easy to say “use a weaker chip”, but what if that means you have to degrade some must-have functionality? Or it means you have to wait 3 years for TSMC to come out with a smaller node before you can release your product? Battery on the end of a wire is a “bold” choice, probably an engineer won a cage match against an executive to make it happen.
- tristanb 3y agoOr you could just use transparent lenses you can vary the darkness of... but hey I'm not building it.
- fshbbdssbbgdd 3y agoOk, you just gave yourself a different set of hard engineering problems to solve. Turns out that field-of-view, brightness, color reproduction, and resolution are all difficult to achieve on that kind of display. You can try a Magic Leap 2 if you want to experience those constraints. One thing that Apple’s approach has going for it is that it could also be great at VR content like Beat Saber, Half Life Alyx, Bigscreen movies, or as a monitor for your MacBook. A Magic-Leap-esque device will suck for any of those. However, the Magic Leap form factor may work better for a Google Glass type use case where you wear the headset as you go about your life and get some augmented features (maybe it can be an iPhone replacement eventually).