4 ms·
Looks nice, but it should really say single RGB camera AND a boatload of processing power. TLDR the camera feeds 1280x720 images at 120fps to a PC (with graphic
by alexisread 1y ago
Looks nice, but it should really say single RGB camera AND a boatload of processing power.
TLDR the camera feeds 1280x720 images at 120fps to a PC (with graphics card). While you could reduce this to an on-chip processing block, it will also have to deal with people looking away halfway through typing etc. which adds to the processing overhead, and requires integration with the headset (6 axis sensors etc.).
IRL this has been somewhat tried with the Humane AI pin, with gestures, less than instantaneous response is noticeable, so latency has to be paramount.
Don't mean to rain on the parade as it's a nice piece of work, but comparing to say chording (low cpu requirements, better accuracy, faster, but you have to learn how to chord) shows the different tradeoffs.