3 ms·
SIMT let's a scheduler get clever about memory accesses, SIMD can practically only access memory linearly (scatter gather can do better but it's still usually q
by mhh__ 3y ago
SIMT let's a scheduler get clever about memory accesses, SIMD can practically only access memory linearly (scatter gather can do better but it's still usually quite linear) whereas SIMT can be much smarter in terms of having lots of similar bits of work going on in ways that use the bandwidth maximally and don't overlap.
- kllrnohj 3y agohttps://developer.nvidia.com/blog/how-access-global-memory-efficiently-cuda-c-kernels/ https://developer.nvidia.com/blog/how-access-global-memory-e... SIMT still expects coalesced memory access that's close together otherwise performance falls off a cliff
- the_svd_doctor 3y agoYes, but not all thread in the block need to. As long as you fill a cache line you’re good.