Really well written blog, explaining all the concepts introduced in details. >> Profiling our naive kernel I would highly recommend trying out NVIDIA NSight S

Really well written blog, explaining all the concepts introduced in details. >> Profiling our naive kernel I would highly recommend trying out NVIDIA NSight Systems to help profiling: it gives a lot of information while optimizing for CUDA (together with info on CPU, NVTX markers, Vulkan,OpenGL etc).