3 ms·
From CPU to NPU: The Secret to ~15x Faster AI on Intel's Latest Chips
- samontab 2y agoI was curious about the new NPU in the latest Intel chips, so I did a benchmark with the ResNet-50 model (a very popular image classifier introduced in 2015 by Microsoft), and it turns out that running the model compiled for the NPU gives you about 15 times better performance than the CPU. This boost is for both, latency and throughput.