Not unless you're writing the backend CUDA code for TF honestly. Most of the time you're accessing your data/models/structure through the TF API so you really a

Not unless you're writing the backend CUDA code for TF honestly. Most of the time you're accessing your data/models/structure through the TF API so you really aren't doing too much that directly interfaces with the GPU. To put it another way, when you're developing ML models (99.9% of the time), it's not like people are writing if statements in CUDA.