Local inferencing eliminates the round trip latency to/from the cloud. Also, for wireless sensors, you save power by not having to turn on your radio transmitt

Local inferencing eliminates the round trip latency to/from the cloud. Also, for wireless sensors, you save power by not having to turn on your radio transmitter and receiver on. For non-battery / line powered devices, thermal design is a big consideration at the edge. Running high powered GPUs in non-environmentally controlled environments is difficult. Low power AI chipsets can help reduce product cost, design cost (simpler thermal designs), and decrease product SWaPs.