3 ms·
Those are tensor cores, not cuda cores. They're used for AI rather than general compute/shaders. The 4090 has 512 of those. Correct me if I'm wrong, but as far
by ben-schaaf 3y ago
Those are tensor cores, not cuda cores. They're used for AI rather than general compute/shaders. The 4090 has 512 of those.
Correct me if I'm wrong, but as far as I can tell tensor cores are just accelerators. They can't do general compute: no branch or jump.
- 6keZbCECT2uB 3y agoThe tensor core accelerates mostly matrix operations and is the big block you can see has 4 per SM. Cuda core refers to the thread per SM, which you can see as FP32 or INT32 units, so there are (32*4) per SM on that diagram. Like you said, tensor core is similar to a special purpose ALU and is at a lower level of abstraction than something with an instruction pointer.