3 ms·
Yes, and it's a very important property of CNNs. You can do the hard computational work of training in the data center, but get results from inferencing at the
by jdietrich 8y ago
Yes, and it's a very important property of CNNs. You can do the hard computational work of training in the data center, but get results from inferencing at the edge. In a sense, you're using the trained network as an energy storage system, shifting energy requirements away from power- and cost-constrained devices.
Inferencing is also highly amicable to hardware optimisation, which we're starting to see in the latest flagship mobile SoCs. I expect to see low-cost microcontrollers with inference accelerators within the next couple of years.
- deleted 8y ago[deleted]