2 ms·
I'm not talking about the SIMD portion of Volta. I'm talking about Volta's ability to detect dependencies. Which is null: the core itself probably can't detect
by dragontamer 6y ago
I'm not talking about the SIMD portion of Volta.
I'm talking about Volta's ability to detect dependencies. Which is null: the core itself probably can't detect dependencies at all. Its entirely left up to the compiler (or at least... it seems to be the case).
AMD's GCN and RDNA architecture is still scanning for read/write hazards like any ol' pipelined architecture you learned in college. The NVidia Volta thing is new, and probably should be studied from a architectural point of view.
Yeah, its a GPU-feature on NVidia Volta. But its pretty obvious to me that this explicit dependency-barrier thing could be part of a future ISA, even one for traditional CPUs.
- rrss 6y agoFWIW, this article suggests the static software scheduling you are describing was introduced in Kepler, so it's probably at least not entirely new in Volta: https://www.anandtech.com/show/5699/nvidia-geforce-gtx-680-review/3 https://www.anandtech.com/show/5699/nvidia-geforce-gtx-680-r... > NVIDIA has replaced Fermi’s complex scheduler with a far simpler scheduler that still uses scoreboarding and other methods for inter-warp scheduling, but moves the scheduling of instructions in a warp into NVIDIA’s compiler. In essence it’s a return to static scheduling and I think this is describing more or less the same thing in Maxwell: https://github.com/NervanaSystems/maxas/wiki/Control-Codes https://github.com/NervanaSystems/maxas/wiki/Control-Codes
- dragontamer 6y agoI appreciate the info. Apparently NVidia has been doing this for more years than I expected.