2 ms·
The article would have been much better for me if it drew conclusions about the usefulness of the two (partial) instruction sets. What can you do easily and wh
by Someone 4y ago
The article would have been much better for me if it drew conclusions about the usefulness of the two (partial) instruction sets.
What can you do easily and what’s hard?
I also expected to read something about relative performance of the two.
- stephencanon 4y agoThe main obvious thing is that Intel simply doesn’t have fp32 or fp64 support. If you primarily care about ML inference, that mostly doesn’t matter to you; if you care about other types of dense computation as well, it matters a lot.
- corsix 4y agoPerformance comparison is hard given that the Intel one hasn’t shipped yet.
- dougall 4y agoYeah, I think Intel's only number so far is "2048 int8 operations/cycle/core" (as opposed to VNNI's 256): https://www.servethehome.com/wp-content/uploads/2021/09/Intel-Architecture-Day-2021-Golden-Cove-AMX-1.jpg https://www.servethehome.com/wp-content/uploads/2021/09/Inte... Which (assuming 1 multiply-add = 2 operations) is the same int8 operations/cycle as the Apple M1's float16 operations/cycle. Intel's 16-bit operations might be the same rate, but I'd guess half? That'll almost certainly be at a higher clock-speed, and one-per-core rather than one-per-four-P-cores. (And I think Apple might have doubled their throughput in M2. As you said, performance comparison is hard.)