I don’t know much about Intel’s toolchain: people say good stuff about TBB and things like that. Historically doing inference on Intel gear was mostly about wh

I don’t know much about Intel’s toolchain: people say good stuff about TBB and things like that. Historically doing inference on Intel gear was mostly about whether or not to target AVX2 or AVX512 when building Eigen or whatever. A few years ago the net win was AVX2 because the de-clock and re-clock just killed you. What’s the game these days? Long term I doubt inference will be done on x86, but I think a lot of people still do it.