3 ms·
And we'll start to see more battery-efficient hardware to run those apps without consuming all of your battery. :) (I'm saying that glibly, but I'm dead seriou
by dgacmu 9y ago
And we'll start to see more battery-efficient hardware to run those apps without consuming all of your battery. :)
(I'm saying that glibly, but I'm dead serious -- look at what we've seen emerge just this year in Apple's Neural Engine, the Pixel Visual Core, rumored chips from Qualcomm, and the Movidius Myriad 2. The datacenter was the first place to get dedicated DNN accelerators in the form of Google's TPU, but the phones -- and even smaller devices, like the "clips" camera -- are the clear next spot. And this is why, for example, TensorFlow Lite can call into the Android DNNAPI to take advantage of local accelerators as they evolve.
Being able to run locally, if battery life is preserved, is a huge win in latency, privacy, potentially bandwidth, etc. It'll be good, though it does need advances in both the HW and the DNN techniques (things like Mobilenet, but we need far more).
- fiatjaf 9y agoThank you.