2 ms·
NVidia's CUDA into PTX into SASS is pretty darn good. The SASS assembly on NVidia's instruction set seems to be manually creating read/write barriers at the as
by dragontamer 5y ago
NVidia's CUDA into PTX into SASS is pretty darn good.
The SASS assembly on NVidia's instruction set seems to be manually creating read/write barriers at the assembly program level instead of leaving it up to the decoder. PTX exists as the intermediate step before SASS for a reason: all of that read/write barrier placement is extremely complicated.
CUDA cheats by making the programmer do a significant amount of the heavy lifting: the programmer needs to write in an implicitly parallel style. But once written in that manner, the compiler / computer can execute the code in parallel. The biggest win for NVidia was convincing enough programmers to change paradigms and write code differently.