I found this talk helpful. https://on-demand.gputechconf.com/gtc/2017/presentation/s7122-stephen-jones-cuda-optimization-tips-tricks-and-techniques.pdf https://

I found this talk helpful. https://on-demand.gputechconf.com/gtc/2017/presentation/s7122-stephen-jones-cuda-optimization-tips-tricks-and-techniques.pdf https://on-demand.gputechconf.com/gtc/2017/presentation/s712... Have you tried the Visual Profiler yet?