4 ms·
Isn’t the issue with AVX-512 is that different CPUs support different instructions? https://en.m.wikipedia.org/wiki/AVX-512 https://en.m.wikipedia.org/wiki/AVX-
by dogma1138 6y ago
Isn’t the issue with AVX-512 is that different CPUs support different instructions? https://en.m.wikipedia.org/wiki/AVX-512 https://en.m.wikipedia.org/wiki/AVX-512
It might eventually get normalized but atm it’s a bit of a mess.
- wtallis 6y agoIt's a bit less messy if you ignore the GPU-like Xeon Phi (Knights Landing and Knights Mill) and the failed Cannonlake that Intel definitely would prefer everyone pretend never happened. But that still leaves you with a progression of four levels of expanding support, and the Cooper Lake mess of having BFLOAT16 but not the stuff added in Ice Lake and Tiger Lake. If you don't cut down the support table to eliminate irrelevant niche products, it's most of the way to being a Gray code.
- dogma1138 6y agoI think Icelake and Tiger lake not having BF16 is going to be a big issue especially for machine learning applications, I can’t find what Rocket Lake supports yet but I’m guessing it’s going to be similar to Tiger Lake. There is also the big unknown of what kind of support AMD will bring to the table. I think Intel is banking on people using OneAPI more than writing AVX-512 code using intrinsics or compiler magic. At that point compatibility might be not as much of an issue if you ignore potentially drastic differences in performance.
- 37ef_ced3 6y agoIf you limit yourself to the Foundation instruction set (AVX-512F) you get a lot of benefit and maximum compatibility. That's what https://NN-512.com https://NN-512.com does