3 ms·
They are targeting edge devices like your phone or watch. Computations that use too much battery (e.g., because they do too many cache misses) have to go to the
by KKKKkkkk1 4y ago
They are targeting edge devices like your phone or watch. Computations that use too much battery (e.g., because they do too many cache misses) have to go to the cloud.
I am guessing the reason they're targeting edge is because the technology is energy efficient but slow. Any experts can chime in?
- c_o_n_v_e_x 4y agoLocal inferencing eliminates the round trip latency to/from the cloud. Also, for wireless sensors, you save power by not having to turn on your radio transmitter and receiver on. For non-battery / line powered devices, thermal design is a big consideration at the edge. Running high powered GPUs in non-environmentally controlled environments is difficult. Low power AI chipsets can help reduce product cost, design cost (simpler thermal designs), and decrease product SWaPs.