3 ms·
Finally getting some tidbits of information on CDNA: and there's a few interesting pieces of information here. 1. MI100 supports "Matrix Ops". I don't know if
by dragontamer 6y ago
Finally getting some tidbits of information on CDNA: and there's a few interesting pieces of information here.
1. MI100 supports "Matrix Ops". I don't know if that's just dot-product, or if its a true 4x4 matrix operation. But MI100 is supporting 32-bits worth of matrix ops, which is pretty substantial (NVidia A100 only has 16-bit matrix operations).
2. We know that the MI100 was selected for a number of supercomputers: El Capitan probably is the one that will be deployed the soonest. So some supercomputer engineers saw the NDAs and decided the MI100 was good enough to invest into.
3. This "CDNA" architecture looks different and new. Some rumors was that CDNA was based off of Vega, but Vega never had such high FP16, BFloat16, or FP32-matrix ops. RDNA was 32-operations per vector, but CDNA is looking to be 64-operations per vector. Very curious, I hope that a more detailed whitepaper comes by soon.