Commonly-used HPC profilers support Python and various instrumentation, including CUDA. That's at least Extrae, native TAU, and Score-p (with a plugin, possibly

Commonly-used HPC profilers support Python and various instrumentation, including CUDA. That's at least Extrae, native TAU, and Score-p (with a plugin, possibly under TAU). Note that hardware counters are a can of worms.