Many inference tasks can fit in cache or eDRAM. The SIMD units are not fasts enough to make it a big problem so long as the code is well-optimized. On the Nerv

Many inference tasks can fit in cache or eDRAM. The SIMD units are not fasts enough to make it a big problem so long as the code is well-optimized. On the Nervana front, outrunning a GPU for neural nets is not that hard with an ASIC. I checked your profile, I bet your employer knows something about that :)