3 ms·
> sounds good, but each SM drives 128 “CUDA cores”, each corresponding to a thread in the SIMT programming model. Per thread, we get about 0.09 bytes of memory
by shaklee3 5y ago
> sounds good, but each SM drives 128 “CUDA cores”, each corresponding to a thread in the SIMT programming model. Per thread, we get about 0.09 bytes of memory bandwidth per cycle – or perhaps less awkward at this scale, one byte every 11 instructions.
This is a weird/incorrect way of looking at memory bandwidth on a GPU. You can saturate the memory bandwidth without using even close to all of the threads available. I'm not sure why the author chose to use this metric rather than simply running a benchmark.