4 ms·
This is how Meta does it: With supported keyboards (basically Apple and Logitech’s offerings atm), they load up a tracked 3D model of the keyboard and then pul
by trafficante 3y ago
This is how Meta does it:
With supported keyboards (basically Apple and Logitech’s offerings atm), they load up a tracked 3D model of the keyboard and then pull in an overlaid video feed of your real hands. With non-supported keyboards, the video feed is more of a small “window” that also captures the keyboard.
And when it works, it’s honestly very impressive (especially with color passthrough).
I fully expect Apple to have a more robust and less buggy version ready to go - and with the much higher specs they’ll probably be able to get a lot of “wows” from the demos.